[==========] Running 13 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 3 tests from LeadershipChangeReportingTest
[ RUN ] LeadershipChangeReportingTest.TestConcurrentGetTableLocations
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260808 13:47:40.321933 17263 thread.cc:641] rpc reactor (reactor) Time spent creating pthread: real 1.243s user 0.451s sys 0.788s
W20260808 13:47:40.322633 17263 thread.cc:608] rpc reactor (reactor) Time spent starting thread: real 1.244s user 0.451s sys 0.792s
I20260808 13:47:40.328374 17263 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.219.254:42989
I20260808 13:47:40.331581 17263 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 13:47:40.333338 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:47:40.349797 17274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:40.350481 17275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:40.472934 17277 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:40.473783 17263 server_base.cc:1061] running on GCE node
I20260808 13:47:40.475224 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:47:40.475528 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:47:40.475746 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196860475725 us; error 0 us; skew 500 ppm
I20260808 13:47:40.476907 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:47:40.482509 17263 webserver.cc:533] Webserver started at http://127.16.219.254:37715/ using document root <none> and password file <none>
I20260808 13:47:40.483891 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:47:40.484150 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:47:40.484747 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:47:40.492092 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786196858807110-17263-0/minicluster-data/master-0-root/instance:
uuid: "d74a9c53238143a8a2e465d14e75d556"
format_stamp: "Formatted at 2026-08-08 13:47:40 on dist-test-slave-mn4r"
I20260808 13:47:40.502581 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.009s user 0.010s sys 0.001s
I20260808 13:47:40.509665 17283 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:40.511456 17263 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260808 13:47:40.511955 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786196858807110-17263-0/minicluster-data/master-0-root
uuid: "d74a9c53238143a8a2e465d14e75d556"
format_stamp: "Formatted at 2026-08-08 13:47:40 on dist-test-slave-mn4r"
I20260808 13:47:40.512336 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786196858807110-17263-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786196858807110-17263-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786196858807110-17263-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:47:40.532024 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:47:40.533910 17263 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 13:47:40.534464 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:47:40.625524 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.254:42989
I20260808 13:47:40.625730 17336 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.254:42989 every 8 connection(s)
I20260808 13:47:40.635144 17337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:47:40.660712 17337 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d74a9c53238143a8a2e465d14e75d556: Bootstrap starting.
I20260808 13:47:40.669236 17337 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d74a9c53238143a8a2e465d14e75d556: Neither blocks nor log segments found. Creating new log.
I20260808 13:47:40.671787 17337 log.cc:826] T 00000000000000000000000000000000 P d74a9c53238143a8a2e465d14e75d556: Log is configured to *not* fsync() on all Append() calls
I20260808 13:47:40.677259 17337 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d74a9c53238143a8a2e465d14e75d556: No bootstrap required, opened a new log
I20260808 13:47:40.699842 17337 raft_consensus.cc:359] T 00000000000000000000000000000000 P d74a9c53238143a8a2e465d14e75d556 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d74a9c53238143a8a2e465d14e75d556" member_type: VOTER }
I20260808 13:47:40.700558 17337 raft_consensus.cc:385] T 00000000000000000000000000000000 P d74a9c53238143a8a2e465d14e75d556 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:47:40.700802 17337 raft_consensus.cc:740] T 00000000000000000000000000000000 P d74a9c53238143a8a2e465d14e75d556 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d74a9c53238143a8a2e465d14e75d556, State: Initialized, Role: FOLLOWER
I20260808 13:47:40.702299 17337 consensus_queue.cc:260] T 00000000000000000000000000000000 P d74a9c53238143a8a2e465d14e75d556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d74a9c53238143a8a2e465d14e75d556" member_type: VOTER }
I20260808 13:47:40.702829 17337 raft_consensus.cc:399] T 00000000000000000000000000000000 P d74a9c53238143a8a2e465d14e75d556 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 13:47:40.703155 17337 raft_consensus.cc:493] T 00000000000000000000000000000000 P d74a9c53238143a8a2e465d14e75d556 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 13:47:40.703548 17337 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d74a9c53238143a8a2e465d14e75d556 [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:47:40.707880 17337 raft_consensus.cc:515] T 00000000000000000000000000000000 P d74a9c53238143a8a2e465d14e75d556 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d74a9c53238143a8a2e465d14e75d556" member_type: VOTER }
I20260808 13:47:40.708755 17337 leader_election.cc:304] T 00000000000000000000000000000000 P d74a9c53238143a8a2e465d14e75d556 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d74a9c53238143a8a2e465d14e75d556; no voters:
I20260808 13:47:40.710835 17337 leader_election.cc:290] T 00000000000000000000000000000000 P d74a9c53238143a8a2e465d14e75d556 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 13:47:40.711416 17341 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d74a9c53238143a8a2e465d14e75d556 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 13:47:40.714357 17341 raft_consensus.cc:697] T 00000000000000000000000000000000 P d74a9c53238143a8a2e465d14e75d556 [term 1 LEADER]: Becoming Leader. State: Replica: d74a9c53238143a8a2e465d14e75d556, State: Running, Role: LEADER
I20260808 13:47:40.715282 17341 consensus_queue.cc:237] T 00000000000000000000000000000000 P d74a9c53238143a8a2e465d14e75d556 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d74a9c53238143a8a2e465d14e75d556" member_type: VOTER }
I20260808 13:47:40.716336 17337 sys_catalog.cc:565] T 00000000000000000000000000000000 P d74a9c53238143a8a2e465d14e75d556 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 13:47:40.726892 17343 sys_catalog.cc:455] T 00000000000000000000000000000000 P d74a9c53238143a8a2e465d14e75d556 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d74a9c53238143a8a2e465d14e75d556. Latest consensus state: current_term: 1 leader_uuid: "d74a9c53238143a8a2e465d14e75d556" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d74a9c53238143a8a2e465d14e75d556" member_type: VOTER } }
I20260808 13:47:40.727595 17343 sys_catalog.cc:458] T 00000000000000000000000000000000 P d74a9c53238143a8a2e465d14e75d556 [sys.catalog]: This master's current role is: LEADER
I20260808 13:47:40.729367 17342 sys_catalog.cc:455] T 00000000000000000000000000000000 P d74a9c53238143a8a2e465d14e75d556 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d74a9c53238143a8a2e465d14e75d556" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d74a9c53238143a8a2e465d14e75d556" member_type: VOTER } }
I20260808 13:47:40.730113 17342 sys_catalog.cc:458] T 00000000000000000000000000000000 P d74a9c53238143a8a2e465d14e75d556 [sys.catalog]: This master's current role is: LEADER
I20260808 13:47:40.735596 17351 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 13:47:40.750945 17351 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 13:47:40.753523 17263 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260808 13:47:40.772822 17351 catalog_manager.cc:1383] Generated new cluster ID: 97318d4d779c45eaaa94db58e05b0b73
I20260808 13:47:40.773201 17351 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 13:47:40.787289 17351 catalog_manager.cc:1406] Generated new certificate authority record
I20260808 13:47:40.789597 17351 catalog_manager.cc:1540] Loading token signing keys...
I20260808 13:47:40.811275 17351 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d74a9c53238143a8a2e465d14e75d556: Generated new TSK 0
I20260808 13:47:40.812333 17351 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 13:47:40.820361 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:47:40.830304 17362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:40.831576 17364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:40.836640 17366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:40.837496 17263 server_base.cc:1061] running on GCE node
I20260808 13:47:40.838361 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:47:40.838575 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:47:40.838760 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196860838744 us; error 0 us; skew 500 ppm
I20260808 13:47:40.839380 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:47:40.844288 17263 webserver.cc:533] Webserver started at http://127.16.219.193:42691/ using document root <none> and password file <none>
I20260808 13:47:40.844851 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:47:40.845193 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:47:40.845533 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:47:40.846901 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786196858807110-17263-0/minicluster-data/ts-0-root/instance:
uuid: "eb056d0de7da4e4d979a19b6a3b94d3e"
format_stamp: "Formatted at 2026-08-08 13:47:40 on dist-test-slave-mn4r"
I20260808 13:47:40.853363 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260808 13:47:40.858366 17371 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:40.859282 17263 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 13:47:40.859576 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786196858807110-17263-0/minicluster-data/ts-0-root
uuid: "eb056d0de7da4e4d979a19b6a3b94d3e"
format_stamp: "Formatted at 2026-08-08 13:47:40 on dist-test-slave-mn4r"
I20260808 13:47:40.859860 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786196858807110-17263-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786196858807110-17263-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786196858807110-17263-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:47:40.877700 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:47:40.879217 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:47:40.882401 17263 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 13:47:40.887575 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 13:47:40.887858 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:40.888146 17263 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 13:47:40.888324 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:41.011191 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.193:46249
I20260808 13:47:41.011288 17436 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.193:46249 every 8 connection(s)
I20260808 13:47:41.019225 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:47:41.037317 17442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:41.038435 17441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:41.054821 17445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:41.055413 17263 server_base.cc:1061] running on GCE node
I20260808 13:47:41.056663 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:47:41.056952 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:47:41.057214 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196861057194 us; error 0 us; skew 500 ppm
I20260808 13:47:41.057322 17437 heartbeater.cc:344] Connected to a master server at 127.16.219.254:42989
I20260808 13:47:41.057861 17437 heartbeater.cc:461] Registering TS with master...
I20260808 13:47:41.058025 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:47:41.059201 17437 heartbeater.cc:507] Master 127.16.219.254:42989 requested a full tablet report, sending...
I20260808 13:47:41.061250 17263 webserver.cc:533] Webserver started at http://127.16.219.194:45585/ using document root <none> and password file <none>
I20260808 13:47:41.062106 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:47:41.062391 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:47:41.062739 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:47:41.063577 17300 ts_manager.cc:194] Registered new tserver with Master: eb056d0de7da4e4d979a19b6a3b94d3e (127.16.219.193:46249)
I20260808 13:47:41.064271 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786196858807110-17263-0/minicluster-data/ts-1-root/instance:
uuid: "f930be091fd443c7b94c4553510bcfb1"
format_stamp: "Formatted at 2026-08-08 13:47:41 on dist-test-slave-mn4r"
I20260808 13:47:41.066205 17300 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56710
I20260808 13:47:41.071988 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.001s sys 0.008s
I20260808 13:47:41.077664 17450 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:41.078649 17263 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260808 13:47:41.079018 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786196858807110-17263-0/minicluster-data/ts-1-root
uuid: "f930be091fd443c7b94c4553510bcfb1"
format_stamp: "Formatted at 2026-08-08 13:47:41 on dist-test-slave-mn4r"
I20260808 13:47:41.079413 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786196858807110-17263-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786196858807110-17263-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestConcurrentGetTableLocations.1786196858807110-17263-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:47:41.105090 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:47:41.106973 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:47:41.109884 17263 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 13:47:41.113988 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 13:47:41.114289 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260808 13:47:41.114614 17263 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 13:47:41.114843 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:41.169838 17437 heartbeater.cc:499] Master 127.16.219.254:42989 was elected leader, sending a full tablet report...
I20260808 13:47:41.220227 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.194:37371
I20260808 13:47:41.220324 17518 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.194:37371 every 8 connection(s)
I20260808 13:47:41.240947 17519 heartbeater.cc:344] Connected to a master server at 127.16.219.254:42989
I20260808 13:47:41.241364 17519 heartbeater.cc:461] Registering TS with master...
I20260808 13:47:41.242412 17519 heartbeater.cc:507] Master 127.16.219.254:42989 requested a full tablet report, sending...
I20260808 13:47:41.244670 17300 ts_manager.cc:194] Registered new tserver with Master: f930be091fd443c7b94c4553510bcfb1 (127.16.219.194:37371)
I20260808 13:47:41.244830 17263 internal_mini_cluster.cc:371] 2 TS(s) registered with all masters after 0.018420949s
I20260808 13:47:41.246495 17300 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56714
I20260808 13:47:41.277179 17300 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56728:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 2
seed: 0
}
range_schema {
columns {
name: "key"
}
}
}
W20260808 13:47:41.300760 17300 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 3 tablet servers would be needed, 2 are available. Consider bringing up more tablet servers.
I20260808 13:47:41.350526 17519 heartbeater.cc:499] Master 127.16.219.254:42989 was elected leader, sending a full tablet report...
I20260808 13:47:41.373778 17482 tablet_service.cc:1511] Processing CreateTablet for tablet 0bc3997998904288853ceae9520cb445 (DEFAULT_TABLE table=test-table [id=f5e36fecefd64970afa2e0ce44a4a623]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260808 13:47:41.373775 17481 tablet_service.cc:1511] Processing CreateTablet for tablet 9c4568f8dba24002a7b0ebf0f3a74d03 (DEFAULT_TABLE table=test-table [id=f5e36fecefd64970afa2e0ce44a4a623]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260808 13:47:41.375890 17482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bc3997998904288853ceae9520cb445. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:47:41.375890 17400 tablet_service.cc:1511] Processing CreateTablet for tablet 0bc3997998904288853ceae9520cb445 (DEFAULT_TABLE table=test-table [id=f5e36fecefd64970afa2e0ce44a4a623]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260808 13:47:41.376730 17481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4568f8dba24002a7b0ebf0f3a74d03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:47:41.377748 17400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bc3997998904288853ceae9520cb445. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:47:41.381094 17399 tablet_service.cc:1511] Processing CreateTablet for tablet 9c4568f8dba24002a7b0ebf0f3a74d03 (DEFAULT_TABLE table=test-table [id=f5e36fecefd64970afa2e0ce44a4a623]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260808 13:47:41.383261 17399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4568f8dba24002a7b0ebf0f3a74d03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:47:41.424058 17534 tablet_bootstrap.cc:492] T 0bc3997998904288853ceae9520cb445 P eb056d0de7da4e4d979a19b6a3b94d3e: Bootstrap starting.
I20260808 13:47:41.426265 17535 tablet_bootstrap.cc:492] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1: Bootstrap starting.
I20260808 13:47:41.431807 17534 tablet_bootstrap.cc:654] T 0bc3997998904288853ceae9520cb445 P eb056d0de7da4e4d979a19b6a3b94d3e: Neither blocks nor log segments found. Creating new log.
I20260808 13:47:41.434653 17535 tablet_bootstrap.cc:654] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1: Neither blocks nor log segments found. Creating new log.
I20260808 13:47:41.438267 17534 tablet_bootstrap.cc:492] T 0bc3997998904288853ceae9520cb445 P eb056d0de7da4e4d979a19b6a3b94d3e: No bootstrap required, opened a new log
I20260808 13:47:41.438843 17534 ts_tablet_manager.cc:1403] T 0bc3997998904288853ceae9520cb445 P eb056d0de7da4e4d979a19b6a3b94d3e: Time spent bootstrapping tablet: real 0.015s user 0.013s sys 0.000s
I20260808 13:47:41.441972 17534 raft_consensus.cc:359] T 0bc3997998904288853ceae9520cb445 P eb056d0de7da4e4d979a19b6a3b94d3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f930be091fd443c7b94c4553510bcfb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37371 } } peers { permanent_uuid: "eb056d0de7da4e4d979a19b6a3b94d3e" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46249 } }
I20260808 13:47:41.442453 17535 tablet_bootstrap.cc:492] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1: No bootstrap required, opened a new log
I20260808 13:47:41.442646 17534 raft_consensus.cc:740] T 0bc3997998904288853ceae9520cb445 P eb056d0de7da4e4d979a19b6a3b94d3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb056d0de7da4e4d979a19b6a3b94d3e, State: Initialized, Role: FOLLOWER
I20260808 13:47:41.442920 17535 ts_tablet_manager.cc:1403] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.011s
I20260808 13:47:41.443262 17534 consensus_queue.cc:260] T 0bc3997998904288853ceae9520cb445 P eb056d0de7da4e4d979a19b6a3b94d3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f930be091fd443c7b94c4553510bcfb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37371 } } peers { permanent_uuid: "eb056d0de7da4e4d979a19b6a3b94d3e" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46249 } }
I20260808 13:47:41.446167 17535 raft_consensus.cc:359] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f930be091fd443c7b94c4553510bcfb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37371 } } peers { permanent_uuid: "eb056d0de7da4e4d979a19b6a3b94d3e" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46249 } }
I20260808 13:47:41.446848 17535 raft_consensus.cc:740] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f930be091fd443c7b94c4553510bcfb1, State: Initialized, Role: FOLLOWER
I20260808 13:47:41.447243 17534 ts_tablet_manager.cc:1434] T 0bc3997998904288853ceae9520cb445 P eb056d0de7da4e4d979a19b6a3b94d3e: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260808 13:47:41.447458 17535 consensus_queue.cc:260] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f930be091fd443c7b94c4553510bcfb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37371 } } peers { permanent_uuid: "eb056d0de7da4e4d979a19b6a3b94d3e" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46249 } }
I20260808 13:47:41.448222 17534 tablet_bootstrap.cc:492] T 9c4568f8dba24002a7b0ebf0f3a74d03 P eb056d0de7da4e4d979a19b6a3b94d3e: Bootstrap starting.
I20260808 13:47:41.457857 17534 tablet_bootstrap.cc:654] T 9c4568f8dba24002a7b0ebf0f3a74d03 P eb056d0de7da4e4d979a19b6a3b94d3e: Neither blocks nor log segments found. Creating new log.
I20260808 13:47:41.474388 17535 ts_tablet_manager.cc:1434] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1: Time spent starting tablet: real 0.031s user 0.015s sys 0.015s
I20260808 13:47:41.475432 17535 tablet_bootstrap.cc:492] T 9c4568f8dba24002a7b0ebf0f3a74d03 P f930be091fd443c7b94c4553510bcfb1: Bootstrap starting.
I20260808 13:47:41.477113 17534 tablet_bootstrap.cc:492] T 9c4568f8dba24002a7b0ebf0f3a74d03 P eb056d0de7da4e4d979a19b6a3b94d3e: No bootstrap required, opened a new log
W20260808 13:47:41.477293 17520 tablet.cc:2406] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 13:47:41.477630 17534 ts_tablet_manager.cc:1403] T 9c4568f8dba24002a7b0ebf0f3a74d03 P eb056d0de7da4e4d979a19b6a3b94d3e: Time spent bootstrapping tablet: real 0.030s user 0.012s sys 0.013s
I20260808 13:47:41.480664 17534 raft_consensus.cc:359] T 9c4568f8dba24002a7b0ebf0f3a74d03 P eb056d0de7da4e4d979a19b6a3b94d3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb056d0de7da4e4d979a19b6a3b94d3e" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46249 } } peers { permanent_uuid: "f930be091fd443c7b94c4553510bcfb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37371 } }
I20260808 13:47:41.481369 17534 raft_consensus.cc:740] T 9c4568f8dba24002a7b0ebf0f3a74d03 P eb056d0de7da4e4d979a19b6a3b94d3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb056d0de7da4e4d979a19b6a3b94d3e, State: Initialized, Role: FOLLOWER
I20260808 13:47:41.482138 17534 consensus_queue.cc:260] T 9c4568f8dba24002a7b0ebf0f3a74d03 P eb056d0de7da4e4d979a19b6a3b94d3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb056d0de7da4e4d979a19b6a3b94d3e" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46249 } } peers { permanent_uuid: "f930be091fd443c7b94c4553510bcfb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37371 } }
I20260808 13:47:41.484419 17534 ts_tablet_manager.cc:1434] T 9c4568f8dba24002a7b0ebf0f3a74d03 P eb056d0de7da4e4d979a19b6a3b94d3e: Time spent starting tablet: real 0.006s user 0.002s sys 0.003s
I20260808 13:47:41.484581 17535 tablet_bootstrap.cc:654] T 9c4568f8dba24002a7b0ebf0f3a74d03 P f930be091fd443c7b94c4553510bcfb1: Neither blocks nor log segments found. Creating new log.
I20260808 13:47:41.498054 17535 tablet_bootstrap.cc:492] T 9c4568f8dba24002a7b0ebf0f3a74d03 P f930be091fd443c7b94c4553510bcfb1: No bootstrap required, opened a new log
I20260808 13:47:41.498598 17535 ts_tablet_manager.cc:1403] T 9c4568f8dba24002a7b0ebf0f3a74d03 P f930be091fd443c7b94c4553510bcfb1: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.017s
I20260808 13:47:41.501547 17535 raft_consensus.cc:359] T 9c4568f8dba24002a7b0ebf0f3a74d03 P f930be091fd443c7b94c4553510bcfb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb056d0de7da4e4d979a19b6a3b94d3e" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46249 } } peers { permanent_uuid: "f930be091fd443c7b94c4553510bcfb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37371 } }
I20260808 13:47:41.502300 17535 raft_consensus.cc:740] T 9c4568f8dba24002a7b0ebf0f3a74d03 P f930be091fd443c7b94c4553510bcfb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f930be091fd443c7b94c4553510bcfb1, State: Initialized, Role: FOLLOWER
I20260808 13:47:41.502787 17535 consensus_queue.cc:260] T 9c4568f8dba24002a7b0ebf0f3a74d03 P f930be091fd443c7b94c4553510bcfb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb056d0de7da4e4d979a19b6a3b94d3e" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46249 } } peers { permanent_uuid: "f930be091fd443c7b94c4553510bcfb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37371 } }
I20260808 13:47:41.504415 17535 ts_tablet_manager.cc:1434] T 9c4568f8dba24002a7b0ebf0f3a74d03 P f930be091fd443c7b94c4553510bcfb1: Time spent starting tablet: real 0.006s user 0.003s sys 0.001s
I20260808 13:47:41.549870 17263 ts_tablet_manager-itest.cc:368] Electing peer 2...
I20260808 13:47:41.550232 17263 raft_consensus.cc:423] T 9c4568f8dba24002a7b0ebf0f3a74d03 P f930be091fd443c7b94c4553510bcfb1 [term 0 FOLLOWER]: Emulating election...
I20260808 13:47:41.550482 17263 raft_consensus.cc:3060] T 9c4568f8dba24002a7b0ebf0f3a74d03 P f930be091fd443c7b94c4553510bcfb1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:47:41.554773 17263 raft_consensus.cc:697] T 9c4568f8dba24002a7b0ebf0f3a74d03 P f930be091fd443c7b94c4553510bcfb1 [term 1 LEADER]: Becoming Leader. State: Replica: f930be091fd443c7b94c4553510bcfb1, State: Running, Role: LEADER
I20260808 13:47:41.555460 17263 consensus_queue.cc:237] T 9c4568f8dba24002a7b0ebf0f3a74d03 P f930be091fd443c7b94c4553510bcfb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb056d0de7da4e4d979a19b6a3b94d3e" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46249 } } peers { permanent_uuid: "f930be091fd443c7b94c4553510bcfb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37371 } }
I20260808 13:47:41.558032 17263 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20260808 13:47:41.566224 17300 catalog_manager.cc:5697] T 9c4568f8dba24002a7b0ebf0f3a74d03 P f930be091fd443c7b94c4553510bcfb1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f930be091fd443c7b94c4553510bcfb1 (127.16.219.194). New cstate: current_term: 1 leader_uuid: "f930be091fd443c7b94c4553510bcfb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb056d0de7da4e4d979a19b6a3b94d3e" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f930be091fd443c7b94c4553510bcfb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37371 } health_report { overall_health: HEALTHY } } }
I20260808 13:47:41.584980 17263 cluster_itest_util.cc:258] Not converged past 0 yet: 0.0 1.1
I20260808 13:47:41.689468 17263 cluster_itest_util.cc:258] Not converged past 0 yet: 0.0 1.1
I20260808 13:47:41.893720 17263 cluster_itest_util.cc:258] Not converged past 0 yet: 0.0 1.1
I20260808 13:47:41.989650 17410 raft_consensus.cc:3060] T 9c4568f8dba24002a7b0ebf0f3a74d03 P eb056d0de7da4e4d979a19b6a3b94d3e [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:47:41.999675 17541 consensus_queue.cc:1048] T 9c4568f8dba24002a7b0ebf0f3a74d03 P f930be091fd443c7b94c4553510bcfb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb056d0de7da4e4d979a19b6a3b94d3e" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260808 13:47:42.198171 17263 ts_tablet_manager-itest.cc:368] Electing peer 3...
I20260808 13:47:42.198428 17263 raft_consensus.cc:423] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 [term 0 FOLLOWER]: Emulating election...
I20260808 13:47:42.198691 17263 raft_consensus.cc:3060] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:47:42.203635 17263 raft_consensus.cc:697] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 [term 1 LEADER]: Becoming Leader. State: Replica: f930be091fd443c7b94c4553510bcfb1, State: Running, Role: LEADER
I20260808 13:47:42.204233 17263 consensus_queue.cc:237] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f930be091fd443c7b94c4553510bcfb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37371 } } peers { permanent_uuid: "eb056d0de7da4e4d979a19b6a3b94d3e" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46249 } }
I20260808 13:47:42.206418 17263 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20260808 13:47:42.210404 17263 cluster_itest_util.cc:258] Not converged past 0 yet: 0.0 1.1
I20260808 13:47:42.210549 17300 catalog_manager.cc:5697] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f930be091fd443c7b94c4553510bcfb1 (127.16.219.194). New cstate: current_term: 1 leader_uuid: "f930be091fd443c7b94c4553510bcfb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f930be091fd443c7b94c4553510bcfb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb056d0de7da4e4d979a19b6a3b94d3e" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46249 } health_report { overall_health: UNKNOWN } } }
I20260808 13:47:42.314692 17263 cluster_itest_util.cc:258] Not converged past 0 yet: 0.0 1.1
I20260808 13:47:42.519593 17263 cluster_itest_util.cc:258] Not converged past 0 yet: 0.0 1.1
I20260808 13:47:42.808286 17410 raft_consensus.cc:3060] T 0bc3997998904288853ceae9520cb445 P eb056d0de7da4e4d979a19b6a3b94d3e [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:47:42.814100 17551 consensus_queue.cc:1048] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb056d0de7da4e4d979a19b6a3b94d3e" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 13:47:43.026823 17263 ts_tablet_manager-itest.cc:368] Electing peer 3...
I20260808 13:47:43.027110 17263 raft_consensus.cc:423] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 [term 1 LEADER]: Emulating election...
I20260808 13:47:43.027346 17263 raft_consensus.cc:3055] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 [term 1 LEADER]: Stepping down as leader of term 1
I20260808 13:47:43.027549 17263 raft_consensus.cc:740] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f930be091fd443c7b94c4553510bcfb1, State: Running, Role: LEADER
I20260808 13:47:43.028062 17263 consensus_queue.cc:260] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f930be091fd443c7b94c4553510bcfb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37371 } } peers { permanent_uuid: "eb056d0de7da4e4d979a19b6a3b94d3e" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46249 } }
I20260808 13:47:43.028985 17263 raft_consensus.cc:3060] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 [term 1 FOLLOWER]: Advancing to term 2
I20260808 13:47:43.032795 17263 raft_consensus.cc:697] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 [term 2 LEADER]: Becoming Leader. State: Replica: f930be091fd443c7b94c4553510bcfb1, State: Running, Role: LEADER
I20260808 13:47:43.033306 17263 consensus_queue.cc:237] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f930be091fd443c7b94c4553510bcfb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37371 } } peers { permanent_uuid: "eb056d0de7da4e4d979a19b6a3b94d3e" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46249 } }
I20260808 13:47:43.034687 17263 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20260808 13:47:43.038585 17263 cluster_itest_util.cc:258] Not converged past 0 yet: 1.1 2.2
I20260808 13:47:43.038229 17299 catalog_manager.cc:5697] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "f930be091fd443c7b94c4553510bcfb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f930be091fd443c7b94c4553510bcfb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb056d0de7da4e4d979a19b6a3b94d3e" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46249 } health_report { overall_health: UNKNOWN } } }
I20260808 13:47:43.143247 17263 cluster_itest_util.cc:258] Not converged past 0 yet: 1.1 2.2
I20260808 13:47:43.348014 17263 cluster_itest_util.cc:258] Not converged past 0 yet: 1.1 2.2
I20260808 13:47:43.624805 17410 raft_consensus.cc:3060] T 0bc3997998904288853ceae9520cb445 P eb056d0de7da4e4d979a19b6a3b94d3e [term 1 FOLLOWER]: Advancing to term 2
I20260808 13:47:43.629575 17410 raft_consensus.cc:1275] T 0bc3997998904288853ceae9520cb445 P eb056d0de7da4e4d979a19b6a3b94d3e [term 2 FOLLOWER]: Refusing update from remote peer f930be091fd443c7b94c4553510bcfb1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260808 13:47:43.630977 17562 consensus_queue.cc:1048] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb056d0de7da4e4d979a19b6a3b94d3e" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260808 13:47:43.651643 17263 ts_tablet_manager-itest.cc:368] Electing peer 0...
I20260808 13:47:43.651906 17263 raft_consensus.cc:423] T 9c4568f8dba24002a7b0ebf0f3a74d03 P eb056d0de7da4e4d979a19b6a3b94d3e [term 1 FOLLOWER]: Emulating election...
I20260808 13:47:43.652144 17263 raft_consensus.cc:3060] T 9c4568f8dba24002a7b0ebf0f3a74d03 P eb056d0de7da4e4d979a19b6a3b94d3e [term 1 FOLLOWER]: Advancing to term 2
I20260808 13:47:43.656201 17263 raft_consensus.cc:697] T 9c4568f8dba24002a7b0ebf0f3a74d03 P eb056d0de7da4e4d979a19b6a3b94d3e [term 2 LEADER]: Becoming Leader. State: Replica: eb056d0de7da4e4d979a19b6a3b94d3e, State: Running, Role: LEADER
I20260808 13:47:43.656728 17263 consensus_queue.cc:237] T 9c4568f8dba24002a7b0ebf0f3a74d03 P eb056d0de7da4e4d979a19b6a3b94d3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb056d0de7da4e4d979a19b6a3b94d3e" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46249 } } peers { permanent_uuid: "f930be091fd443c7b94c4553510bcfb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37371 } }
I20260808 13:47:43.658874 17263 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20260808 13:47:43.662621 17263 cluster_itest_util.cc:258] Not converged past 0 yet: 2.2 1.1
I20260808 13:47:43.662725 17298 catalog_manager.cc:5697] T 9c4568f8dba24002a7b0ebf0f3a74d03 P eb056d0de7da4e4d979a19b6a3b94d3e reported cstate change: term changed from 1 to 2, leader changed from f930be091fd443c7b94c4553510bcfb1 (127.16.219.194) to eb056d0de7da4e4d979a19b6a3b94d3e (127.16.219.193). New cstate: current_term: 2 leader_uuid: "eb056d0de7da4e4d979a19b6a3b94d3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb056d0de7da4e4d979a19b6a3b94d3e" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f930be091fd443c7b94c4553510bcfb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37371 } health_report { overall_health: UNKNOWN } } }
I20260808 13:47:43.756901 17410 raft_consensus.cc:1240] T 9c4568f8dba24002a7b0ebf0f3a74d03 P eb056d0de7da4e4d979a19b6a3b94d3e [term 2 LEADER]: Rejecting Update request from peer f930be091fd443c7b94c4553510bcfb1 for earlier term 1. Current term is 2. Ops: []
I20260808 13:47:43.758114 17571 consensus_queue.cc:1059] T 9c4568f8dba24002a7b0ebf0f3a74d03 P f930be091fd443c7b94c4553510bcfb1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb056d0de7da4e4d979a19b6a3b94d3e" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46249 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260808 13:47:43.758771 17571 consensus_queue.cc:1243] T 9c4568f8dba24002a7b0ebf0f3a74d03 P f930be091fd443c7b94c4553510bcfb1 [LEADER]: Peer eb056d0de7da4e4d979a19b6a3b94d3e log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260808 13:47:43.759123 17562 raft_consensus.cc:3055] T 9c4568f8dba24002a7b0ebf0f3a74d03 P f930be091fd443c7b94c4553510bcfb1 [term 1 LEADER]: Stepping down as leader of term 1
I20260808 13:47:43.759424 17562 raft_consensus.cc:740] T 9c4568f8dba24002a7b0ebf0f3a74d03 P f930be091fd443c7b94c4553510bcfb1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f930be091fd443c7b94c4553510bcfb1, State: Running, Role: LEADER
I20260808 13:47:43.759927 17562 consensus_queue.cc:260] T 9c4568f8dba24002a7b0ebf0f3a74d03 P f930be091fd443c7b94c4553510bcfb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb056d0de7da4e4d979a19b6a3b94d3e" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46249 } } peers { permanent_uuid: "f930be091fd443c7b94c4553510bcfb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37371 } }
I20260808 13:47:43.760636 17562 raft_consensus.cc:3060] T 9c4568f8dba24002a7b0ebf0f3a74d03 P f930be091fd443c7b94c4553510bcfb1 [term 1 FOLLOWER]: Advancing to term 2
I20260808 13:47:43.766995 17263 cluster_itest_util.cc:258] Not converged past 0 yet: 2.2 1.1
I20260808 13:47:43.970741 17263 cluster_itest_util.cc:258] Not converged past 0 yet: 2.2 1.1
I20260808 13:47:44.189350 17492 raft_consensus.cc:1275] T 9c4568f8dba24002a7b0ebf0f3a74d03 P f930be091fd443c7b94c4553510bcfb1 [term 2 FOLLOWER]: Refusing update from remote peer eb056d0de7da4e4d979a19b6a3b94d3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260808 13:47:44.190891 17578 consensus_queue.cc:1048] T 9c4568f8dba24002a7b0ebf0f3a74d03 P eb056d0de7da4e4d979a19b6a3b94d3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f930be091fd443c7b94c4553510bcfb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260808 13:47:44.474592 17263 ts_tablet_manager-itest.cc:368] Electing peer 1...
I20260808 13:47:44.474828 17263 raft_consensus.cc:423] T 0bc3997998904288853ceae9520cb445 P eb056d0de7da4e4d979a19b6a3b94d3e [term 2 FOLLOWER]: Emulating election...
I20260808 13:47:44.475091 17263 raft_consensus.cc:3060] T 0bc3997998904288853ceae9520cb445 P eb056d0de7da4e4d979a19b6a3b94d3e [term 2 FOLLOWER]: Advancing to term 3
I20260808 13:47:44.479087 17263 raft_consensus.cc:697] T 0bc3997998904288853ceae9520cb445 P eb056d0de7da4e4d979a19b6a3b94d3e [term 3 LEADER]: Becoming Leader. State: Replica: eb056d0de7da4e4d979a19b6a3b94d3e, State: Running, Role: LEADER
I20260808 13:47:44.479630 17263 consensus_queue.cc:237] T 0bc3997998904288853ceae9520cb445 P eb056d0de7da4e4d979a19b6a3b94d3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f930be091fd443c7b94c4553510bcfb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37371 } } peers { permanent_uuid: "eb056d0de7da4e4d979a19b6a3b94d3e" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46249 } }
I20260808 13:47:44.480984 17263 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20260808 13:47:44.484911 17263 cluster_itest_util.cc:258] Not converged past 0 yet: 3.3 2.2
I20260808 13:47:44.484799 17298 catalog_manager.cc:5697] T 0bc3997998904288853ceae9520cb445 P eb056d0de7da4e4d979a19b6a3b94d3e reported cstate change: term changed from 2 to 3, leader changed from f930be091fd443c7b94c4553510bcfb1 (127.16.219.194) to eb056d0de7da4e4d979a19b6a3b94d3e (127.16.219.193). New cstate: current_term: 3 leader_uuid: "eb056d0de7da4e4d979a19b6a3b94d3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f930be091fd443c7b94c4553510bcfb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb056d0de7da4e4d979a19b6a3b94d3e" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46249 } health_report { overall_health: HEALTHY } } }
I20260808 13:47:44.588920 17263 cluster_itest_util.cc:258] Not converged past 0 yet: 3.3 2.2
I20260808 13:47:44.792618 17263 cluster_itest_util.cc:258] Not converged past 0 yet: 3.3 2.2
I20260808 13:47:44.801004 17410 raft_consensus.cc:1240] T 0bc3997998904288853ceae9520cb445 P eb056d0de7da4e4d979a19b6a3b94d3e [term 3 LEADER]: Rejecting Update request from peer f930be091fd443c7b94c4553510bcfb1 for earlier term 2. Current term is 3. Ops: []
I20260808 13:47:44.802330 17588 consensus_queue.cc:1059] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb056d0de7da4e4d979a19b6a3b94d3e" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46249 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260808 13:47:44.803473 17588 consensus_queue.cc:1243] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 [LEADER]: Peer eb056d0de7da4e4d979a19b6a3b94d3e log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260808 13:47:44.803821 17589 raft_consensus.cc:3055] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 [term 2 LEADER]: Stepping down as leader of term 2
I20260808 13:47:44.804171 17589 raft_consensus.cc:740] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f930be091fd443c7b94c4553510bcfb1, State: Running, Role: LEADER
I20260808 13:47:44.804729 17589 consensus_queue.cc:260] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f930be091fd443c7b94c4553510bcfb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37371 } } peers { permanent_uuid: "eb056d0de7da4e4d979a19b6a3b94d3e" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46249 } }
I20260808 13:47:44.805339 17589 raft_consensus.cc:3060] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 [term 2 FOLLOWER]: Advancing to term 3
I20260808 13:47:45.028012 17492 raft_consensus.cc:1275] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 [term 3 FOLLOWER]: Refusing update from remote peer eb056d0de7da4e4d979a19b6a3b94d3e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260808 13:47:45.029217 17582 consensus_queue.cc:1048] T 0bc3997998904288853ceae9520cb445 P eb056d0de7da4e4d979a19b6a3b94d3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f930be091fd443c7b94c4553510bcfb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260808 13:47:45.096765 17263 ts_tablet_manager-itest.cc:368] Electing peer 3...
I20260808 13:47:45.097069 17263 raft_consensus.cc:423] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 [term 3 FOLLOWER]: Emulating election...
I20260808 13:47:45.097285 17263 raft_consensus.cc:3060] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 [term 3 FOLLOWER]: Advancing to term 4
I20260808 13:47:45.101547 17263 raft_consensus.cc:697] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 [term 4 LEADER]: Becoming Leader. State: Replica: f930be091fd443c7b94c4553510bcfb1, State: Running, Role: LEADER
I20260808 13:47:45.102213 17263 consensus_queue.cc:237] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f930be091fd443c7b94c4553510bcfb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37371 } } peers { permanent_uuid: "eb056d0de7da4e4d979a19b6a3b94d3e" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46249 } }
I20260808 13:47:45.103516 17263 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20260808 13:47:45.107286 17263 cluster_itest_util.cc:258] Not converged past 0 yet: 3.3 4.4
I20260808 13:47:45.107220 17300 catalog_manager.cc:5697] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 reported cstate change: term changed from 3 to 4, leader changed from eb056d0de7da4e4d979a19b6a3b94d3e (127.16.219.193) to f930be091fd443c7b94c4553510bcfb1 (127.16.219.194). New cstate: current_term: 4 leader_uuid: "f930be091fd443c7b94c4553510bcfb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f930be091fd443c7b94c4553510bcfb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb056d0de7da4e4d979a19b6a3b94d3e" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46249 } health_report { overall_health: UNKNOWN } } }
I20260808 13:47:45.211467 17263 cluster_itest_util.cc:258] Not converged past 0 yet: 3.3 4.4
I20260808 13:47:45.415309 17263 cluster_itest_util.cc:258] Not converged past 0 yet: 3.3 4.4
I20260808 13:47:45.570940 17492 raft_consensus.cc:1240] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 [term 4 LEADER]: Rejecting Update request from peer eb056d0de7da4e4d979a19b6a3b94d3e for earlier term 3. Current term is 4. Ops: []
I20260808 13:47:45.572273 17582 consensus_queue.cc:1059] T 0bc3997998904288853ceae9520cb445 P eb056d0de7da4e4d979a19b6a3b94d3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f930be091fd443c7b94c4553510bcfb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37371 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260808 13:47:45.573264 17582 consensus_queue.cc:1243] T 0bc3997998904288853ceae9520cb445 P eb056d0de7da4e4d979a19b6a3b94d3e [LEADER]: Peer f930be091fd443c7b94c4553510bcfb1 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260808 13:47:45.573585 17597 raft_consensus.cc:3055] T 0bc3997998904288853ceae9520cb445 P eb056d0de7da4e4d979a19b6a3b94d3e [term 3 LEADER]: Stepping down as leader of term 3
I20260808 13:47:45.573865 17597 raft_consensus.cc:740] T 0bc3997998904288853ceae9520cb445 P eb056d0de7da4e4d979a19b6a3b94d3e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb056d0de7da4e4d979a19b6a3b94d3e, State: Running, Role: LEADER
I20260808 13:47:45.574389 17597 consensus_queue.cc:260] T 0bc3997998904288853ceae9520cb445 P eb056d0de7da4e4d979a19b6a3b94d3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f930be091fd443c7b94c4553510bcfb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37371 } } peers { permanent_uuid: "eb056d0de7da4e4d979a19b6a3b94d3e" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46249 } }
I20260808 13:47:45.575232 17597 raft_consensus.cc:3060] T 0bc3997998904288853ceae9520cb445 P eb056d0de7da4e4d979a19b6a3b94d3e [term 3 FOLLOWER]: Advancing to term 4
I20260808 13:47:45.589495 17410 raft_consensus.cc:1275] T 0bc3997998904288853ceae9520cb445 P eb056d0de7da4e4d979a19b6a3b94d3e [term 4 FOLLOWER]: Refusing update from remote peer f930be091fd443c7b94c4553510bcfb1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260808 13:47:45.590745 17589 consensus_queue.cc:1048] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb056d0de7da4e4d979a19b6a3b94d3e" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260808 13:47:45.921058 17263 tablet_server.cc:179] TabletServer@127.16.219.193:0 shutting down...
I20260808 13:47:45.942947 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 13:47:45.943739 17263 tablet_replica.cc:333] T 9c4568f8dba24002a7b0ebf0f3a74d03 P eb056d0de7da4e4d979a19b6a3b94d3e: stopping tablet replica
I20260808 13:47:45.944340 17263 raft_consensus.cc:2243] T 9c4568f8dba24002a7b0ebf0f3a74d03 P eb056d0de7da4e4d979a19b6a3b94d3e [term 2 LEADER]: Raft consensus shutting down.
I20260808 13:47:45.945050 17263 raft_consensus.cc:2272] T 9c4568f8dba24002a7b0ebf0f3a74d03 P eb056d0de7da4e4d979a19b6a3b94d3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260808 13:47:45.947243 17263 tablet_replica.cc:333] T 0bc3997998904288853ceae9520cb445 P eb056d0de7da4e4d979a19b6a3b94d3e: stopping tablet replica
I20260808 13:47:45.947695 17263 raft_consensus.cc:2243] T 0bc3997998904288853ceae9520cb445 P eb056d0de7da4e4d979a19b6a3b94d3e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260808 13:47:45.948094 17263 raft_consensus.cc:2272] T 0bc3997998904288853ceae9520cb445 P eb056d0de7da4e4d979a19b6a3b94d3e [term 4 FOLLOWER]: Raft consensus is shut down!
W20260808 13:47:46.054798 17451 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.219.193:46249: connect: Connection refused (error 111)
W20260808 13:47:46.069165 17451 consensus_peers.cc:597] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 -> Peer eb056d0de7da4e4d979a19b6a3b94d3e (127.16.219.193:46249): Couldn't send request to peer eb056d0de7da4e4d979a19b6a3b94d3e. Status: Network error: Client connection negotiation failed: client connection to 127.16.219.193:46249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 13:47:46.069548 17263 tablet_server.cc:196] TabletServer@127.16.219.193:0 shutdown complete.
I20260808 13:47:46.079685 17263 tablet_server.cc:179] TabletServer@127.16.219.194:0 shutting down...
I20260808 13:47:46.096601 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 13:47:46.097230 17263 tablet_replica.cc:333] T 9c4568f8dba24002a7b0ebf0f3a74d03 P f930be091fd443c7b94c4553510bcfb1: stopping tablet replica
I20260808 13:47:46.097826 17263 raft_consensus.cc:2243] T 9c4568f8dba24002a7b0ebf0f3a74d03 P f930be091fd443c7b94c4553510bcfb1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260808 13:47:46.098325 17263 raft_consensus.cc:2272] T 9c4568f8dba24002a7b0ebf0f3a74d03 P f930be091fd443c7b94c4553510bcfb1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260808 13:47:46.099792 17263 tablet_replica.cc:333] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1: stopping tablet replica
I20260808 13:47:46.100217 17263 raft_consensus.cc:2243] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 [term 4 LEADER]: Raft consensus shutting down.
I20260808 13:47:46.100756 17263 raft_consensus.cc:2272] T 0bc3997998904288853ceae9520cb445 P f930be091fd443c7b94c4553510bcfb1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260808 13:47:46.120419 17263 tablet_server.cc:196] TabletServer@127.16.219.194:0 shutdown complete.
I20260808 13:47:46.128275 17263 master.cc:562] Master@127.16.219.254:42989 shutting down...
I20260808 13:47:46.359858 17360 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Closing
I20260808 13:47:46.519448 17263 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d74a9c53238143a8a2e465d14e75d556 [term 1 LEADER]: Raft consensus shutting down.
I20260808 13:47:46.519987 17263 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d74a9c53238143a8a2e465d14e75d556 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 13:47:46.520318 17263 tablet_replica.cc:333] T 00000000000000000000000000000000 P d74a9c53238143a8a2e465d14e75d556: stopping tablet replica
W20260808 13:47:47.170161 17333 debug-util.cc:398] Leaking SignalData structure 0x7b0800066060 after lost signal to thread 17266
W20260808 13:47:47.537197 17263 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 17333)
I20260808 13:47:48.374523 17263 master.cc:584] Master@127.16.219.254:42989 shutdown complete.
[ OK ] LeadershipChangeReportingTest.TestConcurrentGetTableLocations (9382 ms)
[ RUN ] LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange
I20260808 13:47:48.404109 17263 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.219.254:43271
I20260808 13:47:48.405169 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:47:48.410301 17607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:48.411077 17608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:48.413085 17263 server_base.cc:1061] running on GCE node
W20260808 13:47:48.413599 17611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:48.416640 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:47:48.416850 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:47:48.417016 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196868417000 us; error 0 us; skew 500 ppm
I20260808 13:47:48.417550 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:47:48.419986 17263 webserver.cc:533] Webserver started at http://127.16.219.254:45253/ using document root <none> and password file <none>
I20260808 13:47:48.420454 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:47:48.420660 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:47:48.420924 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:47:48.421976 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786196858807110-17263-0/minicluster-data/master-0-root/instance:
uuid: "fd0a94c00f55440889e01855dbbe7a57"
format_stamp: "Formatted at 2026-08-08 13:47:48 on dist-test-slave-mn4r"
I20260808 13:47:48.426265 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 13:47:48.429431 17616 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:48.430250 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 13:47:48.430528 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786196858807110-17263-0/minicluster-data/master-0-root
uuid: "fd0a94c00f55440889e01855dbbe7a57"
format_stamp: "Formatted at 2026-08-08 13:47:48 on dist-test-slave-mn4r"
I20260808 13:47:48.430810 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786196858807110-17263-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786196858807110-17263-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786196858807110-17263-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:47:48.440212 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:47:48.441164 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:47:48.477850 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.254:43271
I20260808 13:47:48.477959 17674 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.254:43271 every 8 connection(s)
I20260808 13:47:48.481724 17675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:47:48.490923 17675 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd0a94c00f55440889e01855dbbe7a57: Bootstrap starting.
I20260808 13:47:48.495078 17675 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fd0a94c00f55440889e01855dbbe7a57: Neither blocks nor log segments found. Creating new log.
I20260808 13:47:48.498991 17675 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd0a94c00f55440889e01855dbbe7a57: No bootstrap required, opened a new log
I20260808 13:47:48.500946 17675 raft_consensus.cc:359] T 00000000000000000000000000000000 P fd0a94c00f55440889e01855dbbe7a57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd0a94c00f55440889e01855dbbe7a57" member_type: VOTER }
I20260808 13:47:48.501392 17675 raft_consensus.cc:385] T 00000000000000000000000000000000 P fd0a94c00f55440889e01855dbbe7a57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:47:48.501634 17675 raft_consensus.cc:740] T 00000000000000000000000000000000 P fd0a94c00f55440889e01855dbbe7a57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd0a94c00f55440889e01855dbbe7a57, State: Initialized, Role: FOLLOWER
I20260808 13:47:48.502341 17675 consensus_queue.cc:260] T 00000000000000000000000000000000 P fd0a94c00f55440889e01855dbbe7a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd0a94c00f55440889e01855dbbe7a57" member_type: VOTER }
I20260808 13:47:48.502801 17675 raft_consensus.cc:399] T 00000000000000000000000000000000 P fd0a94c00f55440889e01855dbbe7a57 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 13:47:48.503031 17675 raft_consensus.cc:493] T 00000000000000000000000000000000 P fd0a94c00f55440889e01855dbbe7a57 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 13:47:48.503329 17675 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fd0a94c00f55440889e01855dbbe7a57 [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:47:48.507340 17675 raft_consensus.cc:515] T 00000000000000000000000000000000 P fd0a94c00f55440889e01855dbbe7a57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd0a94c00f55440889e01855dbbe7a57" member_type: VOTER }
I20260808 13:47:48.507843 17675 leader_election.cc:304] T 00000000000000000000000000000000 P fd0a94c00f55440889e01855dbbe7a57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fd0a94c00f55440889e01855dbbe7a57; no voters:
I20260808 13:47:48.509025 17675 leader_election.cc:290] T 00000000000000000000000000000000 P fd0a94c00f55440889e01855dbbe7a57 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 13:47:48.509315 17678 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fd0a94c00f55440889e01855dbbe7a57 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 13:47:48.510697 17678 raft_consensus.cc:697] T 00000000000000000000000000000000 P fd0a94c00f55440889e01855dbbe7a57 [term 1 LEADER]: Becoming Leader. State: Replica: fd0a94c00f55440889e01855dbbe7a57, State: Running, Role: LEADER
I20260808 13:47:48.511291 17678 consensus_queue.cc:237] T 00000000000000000000000000000000 P fd0a94c00f55440889e01855dbbe7a57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd0a94c00f55440889e01855dbbe7a57" member_type: VOTER }
I20260808 13:47:48.512039 17675 sys_catalog.cc:565] T 00000000000000000000000000000000 P fd0a94c00f55440889e01855dbbe7a57 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 13:47:48.516008 17679 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd0a94c00f55440889e01855dbbe7a57 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fd0a94c00f55440889e01855dbbe7a57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd0a94c00f55440889e01855dbbe7a57" member_type: VOTER } }
I20260808 13:47:48.516683 17679 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd0a94c00f55440889e01855dbbe7a57 [sys.catalog]: This master's current role is: LEADER
I20260808 13:47:48.516119 17680 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd0a94c00f55440889e01855dbbe7a57 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd0a94c00f55440889e01855dbbe7a57. Latest consensus state: current_term: 1 leader_uuid: "fd0a94c00f55440889e01855dbbe7a57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd0a94c00f55440889e01855dbbe7a57" member_type: VOTER } }
I20260808 13:47:48.517429 17680 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd0a94c00f55440889e01855dbbe7a57 [sys.catalog]: This master's current role is: LEADER
I20260808 13:47:48.518600 17685 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 13:47:48.526818 17685 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 13:47:48.531309 17263 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260808 13:47:48.537019 17685 catalog_manager.cc:1383] Generated new cluster ID: a4748bafb3df4748bb4d9765afa7fea6
I20260808 13:47:48.537281 17685 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 13:47:48.569422 17685 catalog_manager.cc:1406] Generated new certificate authority record
I20260808 13:47:48.570730 17685 catalog_manager.cc:1540] Loading token signing keys...
I20260808 13:47:48.585655 17685 catalog_manager.cc:6070] T 00000000000000000000000000000000 P fd0a94c00f55440889e01855dbbe7a57: Generated new TSK 0
I20260808 13:47:48.586323 17685 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 13:47:48.597909 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:47:48.604077 17699 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:48.604570 17700 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:48.607204 17263 server_base.cc:1061] running on GCE node
W20260808 13:47:48.607475 17702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:48.608323 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:47:48.608557 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:47:48.608769 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196868608748 us; error 0 us; skew 500 ppm
I20260808 13:47:48.609229 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:47:48.611470 17263 webserver.cc:533] Webserver started at http://127.16.219.193:41301/ using document root <none> and password file <none>
I20260808 13:47:48.611886 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:47:48.612038 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:47:48.612248 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:47:48.613349 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786196858807110-17263-0/minicluster-data/ts-0-root/instance:
uuid: "1955ab0673ac408d9087af1229e33551"
format_stamp: "Formatted at 2026-08-08 13:47:48 on dist-test-slave-mn4r"
I20260808 13:47:48.617631 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260808 13:47:48.621515 17707 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:48.622421 17263 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 13:47:48.622659 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786196858807110-17263-0/minicluster-data/ts-0-root
uuid: "1955ab0673ac408d9087af1229e33551"
format_stamp: "Formatted at 2026-08-08 13:47:48 on dist-test-slave-mn4r"
I20260808 13:47:48.622885 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786196858807110-17263-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786196858807110-17263-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786196858807110-17263-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:47:48.646142 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:47:48.647135 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:47:48.648507 17263 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 13:47:48.650743 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 13:47:48.650916 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:48.651212 17263 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 13:47:48.651348 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:48.692499 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.193:33237
I20260808 13:47:48.692592 17773 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.193:33237 every 8 connection(s)
I20260808 13:47:48.697479 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:47:48.704562 17778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:48.706314 17779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:48.709560 17782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:48.709959 17263 server_base.cc:1061] running on GCE node
I20260808 13:47:48.711305 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:47:48.711558 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:47:48.711753 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196868711741 us; error 0 us; skew 500 ppm
I20260808 13:47:48.712316 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:47:48.712677 17774 heartbeater.cc:344] Connected to a master server at 127.16.219.254:43271
I20260808 13:47:48.713085 17774 heartbeater.cc:461] Registering TS with master...
I20260808 13:47:48.714063 17774 heartbeater.cc:507] Master 127.16.219.254:43271 requested a full tablet report, sending...
I20260808 13:47:48.715077 17263 webserver.cc:533] Webserver started at http://127.16.219.194:37251/ using document root <none> and password file <none>
I20260808 13:47:48.715790 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:47:48.716082 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:47:48.716408 17634 ts_manager.cc:194] Registered new tserver with Master: 1955ab0673ac408d9087af1229e33551 (127.16.219.193:33237)
I20260808 13:47:48.716459 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:47:48.718012 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786196858807110-17263-0/minicluster-data/ts-1-root/instance:
uuid: "619021cee09c4a09a31d50642049c72f"
format_stamp: "Formatted at 2026-08-08 13:47:48 on dist-test-slave-mn4r"
I20260808 13:47:48.718393 17634 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42610
I20260808 13:47:48.722642 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 13:47:48.725888 17788 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:48.726665 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20260808 13:47:48.726899 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786196858807110-17263-0/minicluster-data/ts-1-root
uuid: "619021cee09c4a09a31d50642049c72f"
format_stamp: "Formatted at 2026-08-08 13:47:48 on dist-test-slave-mn4r"
I20260808 13:47:48.727144 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786196858807110-17263-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786196858807110-17263-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange.1786196858807110-17263-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:47:48.749332 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:47:48.750397 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:47:48.751816 17263 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 13:47:48.754002 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 13:47:48.754263 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:48.754523 17263 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 13:47:48.754678 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:48.795704 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.194:38295
I20260808 13:47:48.795794 17861 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.194:38295 every 8 connection(s)
I20260808 13:47:48.809448 17862 heartbeater.cc:344] Connected to a master server at 127.16.219.254:43271
I20260808 13:47:48.809834 17862 heartbeater.cc:461] Registering TS with master...
I20260808 13:47:48.810567 17862 heartbeater.cc:507] Master 127.16.219.254:43271 requested a full tablet report, sending...
I20260808 13:47:48.812404 17634 ts_manager.cc:194] Registered new tserver with Master: 619021cee09c4a09a31d50642049c72f (127.16.219.194:38295)
I20260808 13:47:48.813421 17263 internal_mini_cluster.cc:371] 2 TS(s) registered with all masters after 0.014344327s
I20260808 13:47:48.813856 17634 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42618
I20260808 13:47:48.820675 17774 heartbeater.cc:499] Master 127.16.219.254:43271 was elected leader, sending a full tablet report...
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc:422: Skipped
test is skipped; set KUDU_ALLOW_SLOW_TESTS=1 to run
I20260808 13:47:48.836128 17263 tablet_server.cc:179] TabletServer@127.16.219.193:0 shutting down...
I20260808 13:47:48.853832 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 13:47:48.869159 17263 tablet_server.cc:196] TabletServer@127.16.219.193:0 shutdown complete.
I20260808 13:47:48.875953 17263 tablet_server.cc:179] TabletServer@127.16.219.194:0 shutting down...
I20260808 13:47:48.892064 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 13:47:48.907804 17263 tablet_server.cc:196] TabletServer@127.16.219.194:0 shutdown complete.
I20260808 13:47:48.914803 17263 master.cc:562] Master@127.16.219.254:43271 shutting down...
I20260808 13:47:48.928404 17263 raft_consensus.cc:2243] T 00000000000000000000000000000000 P fd0a94c00f55440889e01855dbbe7a57 [term 1 LEADER]: Raft consensus shutting down.
I20260808 13:47:48.929060 17263 raft_consensus.cc:2272] T 00000000000000000000000000000000 P fd0a94c00f55440889e01855dbbe7a57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 13:47:48.929441 17263 tablet_replica.cc:333] T 00000000000000000000000000000000 P fd0a94c00f55440889e01855dbbe7a57: stopping tablet replica
I20260808 13:47:48.948241 17263 master.cc:584] Master@127.16.219.254:43271 shutdown complete.
[ SKIPPED ] LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange (567 ms)
[ RUN ] LeadershipChangeReportingTest.TestUpdatedConsensusState
I20260808 13:47:48.970495 17263 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.219.254:43633
I20260808 13:47:48.971457 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:47:48.976049 17876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:48.976783 17877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:48.979560 17263 server_base.cc:1061] running on GCE node
W20260808 13:47:48.979996 17879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:48.980824 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:47:48.980999 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:47:48.981113 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196868981103 us; error 0 us; skew 500 ppm
I20260808 13:47:48.981626 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:47:48.983819 17263 webserver.cc:533] Webserver started at http://127.16.219.254:42249/ using document root <none> and password file <none>
I20260808 13:47:48.984242 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:47:48.984390 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:47:48.984599 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:47:48.985587 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786196858807110-17263-0/minicluster-data/master-0-root/instance:
uuid: "8db498a3eedc413d80e5b42607099525"
format_stamp: "Formatted at 2026-08-08 13:47:48 on dist-test-slave-mn4r"
I20260808 13:47:48.989883 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260808 13:47:48.993129 17885 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:48.993836 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 13:47:48.994127 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786196858807110-17263-0/minicluster-data/master-0-root
uuid: "8db498a3eedc413d80e5b42607099525"
format_stamp: "Formatted at 2026-08-08 13:47:48 on dist-test-slave-mn4r"
I20260808 13:47:48.994388 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786196858807110-17263-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786196858807110-17263-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786196858807110-17263-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:47:49.006829 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:47:49.007748 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:47:49.062016 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.254:43633
I20260808 13:47:49.062171 17940 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.254:43633 every 8 connection(s)
I20260808 13:47:49.067018 17941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:47:49.077481 17941 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8db498a3eedc413d80e5b42607099525: Bootstrap starting.
I20260808 13:47:49.082612 17941 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8db498a3eedc413d80e5b42607099525: Neither blocks nor log segments found. Creating new log.
I20260808 13:47:49.087183 17941 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8db498a3eedc413d80e5b42607099525: No bootstrap required, opened a new log
I20260808 13:47:49.089504 17941 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8db498a3eedc413d80e5b42607099525 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8db498a3eedc413d80e5b42607099525" member_type: VOTER }
I20260808 13:47:49.090121 17941 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8db498a3eedc413d80e5b42607099525 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:47:49.090436 17941 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8db498a3eedc413d80e5b42607099525 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8db498a3eedc413d80e5b42607099525, State: Initialized, Role: FOLLOWER
I20260808 13:47:49.091041 17941 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8db498a3eedc413d80e5b42607099525 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8db498a3eedc413d80e5b42607099525" member_type: VOTER }
I20260808 13:47:49.091534 17941 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8db498a3eedc413d80e5b42607099525 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 13:47:49.091771 17941 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8db498a3eedc413d80e5b42607099525 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 13:47:49.092080 17941 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8db498a3eedc413d80e5b42607099525 [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:47:49.096546 17941 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8db498a3eedc413d80e5b42607099525 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8db498a3eedc413d80e5b42607099525" member_type: VOTER }
I20260808 13:47:49.097065 17941 leader_election.cc:304] T 00000000000000000000000000000000 P 8db498a3eedc413d80e5b42607099525 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8db498a3eedc413d80e5b42607099525; no voters:
I20260808 13:47:49.098304 17941 leader_election.cc:290] T 00000000000000000000000000000000 P 8db498a3eedc413d80e5b42607099525 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 13:47:49.098723 17944 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8db498a3eedc413d80e5b42607099525 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 13:47:49.100066 17944 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8db498a3eedc413d80e5b42607099525 [term 1 LEADER]: Becoming Leader. State: Replica: 8db498a3eedc413d80e5b42607099525, State: Running, Role: LEADER
I20260808 13:47:49.100775 17944 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8db498a3eedc413d80e5b42607099525 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8db498a3eedc413d80e5b42607099525" member_type: VOTER }
I20260808 13:47:49.101313 17941 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8db498a3eedc413d80e5b42607099525 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 13:47:49.104074 17945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8db498a3eedc413d80e5b42607099525 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8db498a3eedc413d80e5b42607099525" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8db498a3eedc413d80e5b42607099525" member_type: VOTER } }
I20260808 13:47:49.104681 17945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8db498a3eedc413d80e5b42607099525 [sys.catalog]: This master's current role is: LEADER
I20260808 13:47:49.104056 17946 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8db498a3eedc413d80e5b42607099525 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8db498a3eedc413d80e5b42607099525. Latest consensus state: current_term: 1 leader_uuid: "8db498a3eedc413d80e5b42607099525" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8db498a3eedc413d80e5b42607099525" member_type: VOTER } }
I20260808 13:47:49.105214 17946 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8db498a3eedc413d80e5b42607099525 [sys.catalog]: This master's current role is: LEADER
I20260808 13:47:49.117050 17949 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 13:47:49.124881 17949 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 13:47:49.125996 17263 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260808 13:47:49.134328 17949 catalog_manager.cc:1383] Generated new cluster ID: 7db5c971b81c44e39a981a9f3d6f917c
I20260808 13:47:49.134632 17949 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 13:47:49.161576 17949 catalog_manager.cc:1406] Generated new certificate authority record
I20260808 13:47:49.162851 17949 catalog_manager.cc:1540] Loading token signing keys...
I20260808 13:47:49.175849 17949 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8db498a3eedc413d80e5b42607099525: Generated new TSK 0
I20260808 13:47:49.176644 17949 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 13:47:49.193481 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:47:49.202579 17964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:49.203703 17965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:49.209373 17263 server_base.cc:1061] running on GCE node
W20260808 13:47:49.210346 17968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:49.211575 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:47:49.211862 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:47:49.212070 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196869212052 us; error 0 us; skew 500 ppm
I20260808 13:47:49.212633 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:47:49.215611 17263 webserver.cc:533] Webserver started at http://127.16.219.193:37087/ using document root <none> and password file <none>
I20260808 13:47:49.216244 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:47:49.216471 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:47:49.216799 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:47:49.218146 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786196858807110-17263-0/minicluster-data/ts-0-root/instance:
uuid: "87568a0bb8e84076bb0cd15dc4f25675"
format_stamp: "Formatted at 2026-08-08 13:47:49 on dist-test-slave-mn4r"
I20260808 13:47:49.223109 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 13:47:49.226565 17975 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:49.227317 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20260808 13:47:49.227595 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786196858807110-17263-0/minicluster-data/ts-0-root
uuid: "87568a0bb8e84076bb0cd15dc4f25675"
format_stamp: "Formatted at 2026-08-08 13:47:49 on dist-test-slave-mn4r"
I20260808 13:47:49.227881 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786196858807110-17263-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786196858807110-17263-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786196858807110-17263-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:47:49.250135 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:47:49.251477 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:47:49.253046 17263 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 13:47:49.255522 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 13:47:49.255749 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:49.255999 17263 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 13:47:49.256189 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:49.296703 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.193:44731
I20260808 13:47:49.296798 18041 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.193:44731 every 8 connection(s)
I20260808 13:47:49.301842 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:47:49.309078 18046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:49.311440 18048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:49.313753 17263 server_base.cc:1061] running on GCE node
W20260808 13:47:49.314288 18050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:49.315482 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:47:49.315781 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:47:49.316077 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196869316053 us; error 0 us; skew 500 ppm
I20260808 13:47:49.316793 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:47:49.317122 18042 heartbeater.cc:344] Connected to a master server at 127.16.219.254:43633
I20260808 13:47:49.317571 18042 heartbeater.cc:461] Registering TS with master...
I20260808 13:47:49.318462 18042 heartbeater.cc:507] Master 127.16.219.254:43633 requested a full tablet report, sending...
I20260808 13:47:49.319552 17263 webserver.cc:533] Webserver started at http://127.16.219.194:44511/ using document root <none> and password file <none>
I20260808 13:47:49.320127 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:47:49.320343 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:47:49.320621 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:47:49.320904 17903 ts_manager.cc:194] Registered new tserver with Master: 87568a0bb8e84076bb0cd15dc4f25675 (127.16.219.193:44731)
I20260808 13:47:49.321899 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786196858807110-17263-0/minicluster-data/ts-1-root/instance:
uuid: "48b0a4e36ef846cc9216bac13d6ae857"
format_stamp: "Formatted at 2026-08-08 13:47:49 on dist-test-slave-mn4r"
I20260808 13:47:49.322744 17903 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37846
I20260808 13:47:49.326932 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 13:47:49.330466 18055 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:49.331214 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 13:47:49.331503 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786196858807110-17263-0/minicluster-data/ts-1-root
uuid: "48b0a4e36ef846cc9216bac13d6ae857"
format_stamp: "Formatted at 2026-08-08 13:47:49 on dist-test-slave-mn4r"
I20260808 13:47:49.331773 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786196858807110-17263-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786196858807110-17263-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.LeadershipChangeReportingTest.TestUpdatedConsensusState.1786196858807110-17263-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:47:49.345073 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:47:49.347062 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:47:49.349088 17263 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 13:47:49.351879 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 13:47:49.352058 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:49.352233 17263 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 13:47:49.352355 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:49.392923 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.194:39895
I20260808 13:47:49.393024 18123 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.194:39895 every 8 connection(s)
I20260808 13:47:49.407951 18124 heartbeater.cc:344] Connected to a master server at 127.16.219.254:43633
I20260808 13:47:49.408322 18124 heartbeater.cc:461] Registering TS with master...
I20260808 13:47:49.408996 18124 heartbeater.cc:507] Master 127.16.219.254:43633 requested a full tablet report, sending...
I20260808 13:47:49.410979 17903 ts_manager.cc:194] Registered new tserver with Master: 48b0a4e36ef846cc9216bac13d6ae857 (127.16.219.194:39895)
I20260808 13:47:49.411862 17263 internal_mini_cluster.cc:371] 2 TS(s) registered with all masters after 0.015794253s
I20260808 13:47:49.412621 17903 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37854
I20260808 13:47:49.425173 18042 heartbeater.cc:499] Master 127.16.219.254:43633 was elected leader, sending a full tablet report...
I20260808 13:47:49.435113 17903 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37868:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 13:47:49.436710 17903 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 3 tablet servers would be needed, 2 are available. Consider bringing up more tablet servers.
I20260808 13:47:49.471501 18084 tablet_service.cc:1511] Processing CreateTablet for tablet 32d60095c4d8478cb2ab130b29432265 (DEFAULT_TABLE table=test-table [id=fd39817021e64831a55864e30bde8f82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 13:47:49.472713 18084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32d60095c4d8478cb2ab130b29432265. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:47:49.473425 18006 tablet_service.cc:1511] Processing CreateTablet for tablet 32d60095c4d8478cb2ab130b29432265 (DEFAULT_TABLE table=test-table [id=fd39817021e64831a55864e30bde8f82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 13:47:49.474649 18006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32d60095c4d8478cb2ab130b29432265. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:47:49.489792 18137 tablet_bootstrap.cc:492] T 32d60095c4d8478cb2ab130b29432265 P 48b0a4e36ef846cc9216bac13d6ae857: Bootstrap starting.
I20260808 13:47:49.491338 18138 tablet_bootstrap.cc:492] T 32d60095c4d8478cb2ab130b29432265 P 87568a0bb8e84076bb0cd15dc4f25675: Bootstrap starting.
I20260808 13:47:49.497452 18137 tablet_bootstrap.cc:654] T 32d60095c4d8478cb2ab130b29432265 P 48b0a4e36ef846cc9216bac13d6ae857: Neither blocks nor log segments found. Creating new log.
I20260808 13:47:49.498690 18138 tablet_bootstrap.cc:654] T 32d60095c4d8478cb2ab130b29432265 P 87568a0bb8e84076bb0cd15dc4f25675: Neither blocks nor log segments found. Creating new log.
I20260808 13:47:49.503372 18137 tablet_bootstrap.cc:492] T 32d60095c4d8478cb2ab130b29432265 P 48b0a4e36ef846cc9216bac13d6ae857: No bootstrap required, opened a new log
I20260808 13:47:49.503785 18137 ts_tablet_manager.cc:1403] T 32d60095c4d8478cb2ab130b29432265 P 48b0a4e36ef846cc9216bac13d6ae857: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.012s
I20260808 13:47:49.504393 18138 tablet_bootstrap.cc:492] T 32d60095c4d8478cb2ab130b29432265 P 87568a0bb8e84076bb0cd15dc4f25675: No bootstrap required, opened a new log
I20260808 13:47:49.504830 18138 ts_tablet_manager.cc:1403] T 32d60095c4d8478cb2ab130b29432265 P 87568a0bb8e84076bb0cd15dc4f25675: Time spent bootstrapping tablet: real 0.014s user 0.012s sys 0.000s
I20260808 13:47:49.506664 18137 raft_consensus.cc:359] T 32d60095c4d8478cb2ab130b29432265 P 48b0a4e36ef846cc9216bac13d6ae857 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48b0a4e36ef846cc9216bac13d6ae857" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 39895 } } peers { permanent_uuid: "87568a0bb8e84076bb0cd15dc4f25675" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 44731 } }
I20260808 13:47:49.507308 18137 raft_consensus.cc:740] T 32d60095c4d8478cb2ab130b29432265 P 48b0a4e36ef846cc9216bac13d6ae857 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48b0a4e36ef846cc9216bac13d6ae857, State: Initialized, Role: FOLLOWER
I20260808 13:47:49.507517 18138 raft_consensus.cc:359] T 32d60095c4d8478cb2ab130b29432265 P 87568a0bb8e84076bb0cd15dc4f25675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48b0a4e36ef846cc9216bac13d6ae857" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 39895 } } peers { permanent_uuid: "87568a0bb8e84076bb0cd15dc4f25675" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 44731 } }
I20260808 13:47:49.508114 18138 raft_consensus.cc:740] T 32d60095c4d8478cb2ab130b29432265 P 87568a0bb8e84076bb0cd15dc4f25675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87568a0bb8e84076bb0cd15dc4f25675, State: Initialized, Role: FOLLOWER
I20260808 13:47:49.507896 18137 consensus_queue.cc:260] T 32d60095c4d8478cb2ab130b29432265 P 48b0a4e36ef846cc9216bac13d6ae857 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48b0a4e36ef846cc9216bac13d6ae857" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 39895 } } peers { permanent_uuid: "87568a0bb8e84076bb0cd15dc4f25675" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 44731 } }
I20260808 13:47:49.508689 18138 consensus_queue.cc:260] T 32d60095c4d8478cb2ab130b29432265 P 87568a0bb8e84076bb0cd15dc4f25675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48b0a4e36ef846cc9216bac13d6ae857" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 39895 } } peers { permanent_uuid: "87568a0bb8e84076bb0cd15dc4f25675" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 44731 } }
I20260808 13:47:49.510201 18124 heartbeater.cc:499] Master 127.16.219.254:43633 was elected leader, sending a full tablet report...
I20260808 13:47:49.510835 18137 ts_tablet_manager.cc:1434] T 32d60095c4d8478cb2ab130b29432265 P 48b0a4e36ef846cc9216bac13d6ae857: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260808 13:47:49.513474 18138 ts_tablet_manager.cc:1434] T 32d60095c4d8478cb2ab130b29432265 P 87568a0bb8e84076bb0cd15dc4f25675: Time spent starting tablet: real 0.008s user 0.005s sys 0.004s
I20260808 13:47:49.548596 17263 ts_tablet_manager-itest.cc:368] Electing peer 0...
I20260808 13:47:49.548815 17263 raft_consensus.cc:423] T 32d60095c4d8478cb2ab130b29432265 P 87568a0bb8e84076bb0cd15dc4f25675 [term 0 FOLLOWER]: Emulating election...
I20260808 13:47:49.548995 17263 raft_consensus.cc:3060] T 32d60095c4d8478cb2ab130b29432265 P 87568a0bb8e84076bb0cd15dc4f25675 [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:47:49.553948 17263 raft_consensus.cc:697] T 32d60095c4d8478cb2ab130b29432265 P 87568a0bb8e84076bb0cd15dc4f25675 [term 1 LEADER]: Becoming Leader. State: Replica: 87568a0bb8e84076bb0cd15dc4f25675, State: Running, Role: LEADER
W20260808 13:47:49.554309 18042 heartbeater.cc:646] Failed to heartbeat to 127.16.219.254:43633 (0 consecutive failures): IO error: failing all heartbeats for tests
I20260808 13:47:49.554646 17263 consensus_queue.cc:237] T 32d60095c4d8478cb2ab130b29432265 P 87568a0bb8e84076bb0cd15dc4f25675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48b0a4e36ef846cc9216bac13d6ae857" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 39895 } } peers { permanent_uuid: "87568a0bb8e84076bb0cd15dc4f25675" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 44731 } }
I20260808 13:47:49.557590 17263 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20260808 13:47:49.574922 17263 cluster_itest_util.cc:258] Not converged past 1 yet: 1.1 0.0
I20260808 13:47:49.679096 17263 cluster_itest_util.cc:258] Not converged past 1 yet: 1.1 0.0
I20260808 13:47:49.883314 17263 cluster_itest_util.cc:258] Not converged past 1 yet: 1.1 0.0
I20260808 13:47:50.173414 18094 raft_consensus.cc:3060] T 32d60095c4d8478cb2ab130b29432265 P 48b0a4e36ef846cc9216bac13d6ae857 [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:47:50.179646 18147 consensus_queue.cc:1048] T 32d60095c4d8478cb2ab130b29432265 P 87568a0bb8e84076bb0cd15dc4f25675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48b0a4e36ef846cc9216bac13d6ae857" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 39895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 13:47:50.190788 17263 ts_tablet_manager-itest.cc:368] Electing peer 0...
I20260808 13:47:50.190973 17263 raft_consensus.cc:423] T 32d60095c4d8478cb2ab130b29432265 P 87568a0bb8e84076bb0cd15dc4f25675 [term 1 LEADER]: Emulating election...
I20260808 13:47:50.191156 17263 raft_consensus.cc:3055] T 32d60095c4d8478cb2ab130b29432265 P 87568a0bb8e84076bb0cd15dc4f25675 [term 1 LEADER]: Stepping down as leader of term 1
I20260808 13:47:50.191421 17263 raft_consensus.cc:740] T 32d60095c4d8478cb2ab130b29432265 P 87568a0bb8e84076bb0cd15dc4f25675 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87568a0bb8e84076bb0cd15dc4f25675, State: Running, Role: LEADER
I20260808 13:47:50.191954 17263 consensus_queue.cc:260] T 32d60095c4d8478cb2ab130b29432265 P 87568a0bb8e84076bb0cd15dc4f25675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48b0a4e36ef846cc9216bac13d6ae857" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 39895 } } peers { permanent_uuid: "87568a0bb8e84076bb0cd15dc4f25675" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 44731 } }
I20260808 13:47:50.192454 17263 raft_consensus.cc:3060] T 32d60095c4d8478cb2ab130b29432265 P 87568a0bb8e84076bb0cd15dc4f25675 [term 1 FOLLOWER]: Advancing to term 2
W20260808 13:47:50.192448 18147 consensus_queue.cc:1175] T 32d60095c4d8478cb2ab130b29432265 P 87568a0bb8e84076bb0cd15dc4f25675 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "48b0a4e36ef846cc9216bac13d6ae857" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260808 13:47:50.196841 17263 raft_consensus.cc:697] T 32d60095c4d8478cb2ab130b29432265 P 87568a0bb8e84076bb0cd15dc4f25675 [term 2 LEADER]: Becoming Leader. State: Replica: 87568a0bb8e84076bb0cd15dc4f25675, State: Running, Role: LEADER
I20260808 13:47:50.197427 17263 consensus_queue.cc:237] T 32d60095c4d8478cb2ab130b29432265 P 87568a0bb8e84076bb0cd15dc4f25675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48b0a4e36ef846cc9216bac13d6ae857" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 39895 } } peers { permanent_uuid: "87568a0bb8e84076bb0cd15dc4f25675" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 44731 } }
I20260808 13:47:50.198714 17263 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20260808 13:47:50.202265 17263 cluster_itest_util.cc:258] Not converged past 2 yet: 2.2 1.1
I20260808 13:47:50.306604 17263 cluster_itest_util.cc:258] Not converged past 2 yet: 2.2 1.1
I20260808 13:47:50.510703 17263 cluster_itest_util.cc:258] Not converged past 2 yet: 2.2 1.1
I20260808 13:47:50.596343 18094 raft_consensus.cc:3060] T 32d60095c4d8478cb2ab130b29432265 P 48b0a4e36ef846cc9216bac13d6ae857 [term 1 FOLLOWER]: Advancing to term 2
I20260808 13:47:50.601670 18094 raft_consensus.cc:1275] T 32d60095c4d8478cb2ab130b29432265 P 48b0a4e36ef846cc9216bac13d6ae857 [term 2 FOLLOWER]: Refusing update from remote peer 87568a0bb8e84076bb0cd15dc4f25675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260808 13:47:50.603164 18147 consensus_queue.cc:1048] T 32d60095c4d8478cb2ab130b29432265 P 87568a0bb8e84076bb0cd15dc4f25675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48b0a4e36ef846cc9216bac13d6ae857" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 39895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260808 13:47:50.816334 17263 ts_tablet_manager-itest.cc:368] Electing peer 0...
I20260808 13:47:50.816608 17263 raft_consensus.cc:423] T 32d60095c4d8478cb2ab130b29432265 P 87568a0bb8e84076bb0cd15dc4f25675 [term 2 LEADER]: Emulating election...
I20260808 13:47:50.816956 17263 raft_consensus.cc:3055] T 32d60095c4d8478cb2ab130b29432265 P 87568a0bb8e84076bb0cd15dc4f25675 [term 2 LEADER]: Stepping down as leader of term 2
I20260808 13:47:50.817181 17263 raft_consensus.cc:740] T 32d60095c4d8478cb2ab130b29432265 P 87568a0bb8e84076bb0cd15dc4f25675 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 87568a0bb8e84076bb0cd15dc4f25675, State: Running, Role: LEADER
I20260808 13:47:50.817685 17263 consensus_queue.cc:260] T 32d60095c4d8478cb2ab130b29432265 P 87568a0bb8e84076bb0cd15dc4f25675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48b0a4e36ef846cc9216bac13d6ae857" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 39895 } } peers { permanent_uuid: "87568a0bb8e84076bb0cd15dc4f25675" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 44731 } }
I20260808 13:47:50.818464 17263 raft_consensus.cc:3060] T 32d60095c4d8478cb2ab130b29432265 P 87568a0bb8e84076bb0cd15dc4f25675 [term 2 FOLLOWER]: Advancing to term 3
I20260808 13:47:50.822420 17263 raft_consensus.cc:697] T 32d60095c4d8478cb2ab130b29432265 P 87568a0bb8e84076bb0cd15dc4f25675 [term 3 LEADER]: Becoming Leader. State: Replica: 87568a0bb8e84076bb0cd15dc4f25675, State: Running, Role: LEADER
I20260808 13:47:50.822938 17263 consensus_queue.cc:237] T 32d60095c4d8478cb2ab130b29432265 P 87568a0bb8e84076bb0cd15dc4f25675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48b0a4e36ef846cc9216bac13d6ae857" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 39895 } } peers { permanent_uuid: "87568a0bb8e84076bb0cd15dc4f25675" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 44731 } }
I20260808 13:47:50.824126 17263 ts_tablet_manager-itest.cc:371] Waiting for servers to agree...
I20260808 13:47:50.827638 17263 cluster_itest_util.cc:258] Not converged past 3 yet: 3.3 2.2
I20260808 13:47:50.931860 17263 cluster_itest_util.cc:258] Not converged past 3 yet: 3.3 2.2
I20260808 13:47:51.136078 17263 cluster_itest_util.cc:258] Not converged past 3 yet: 3.3 2.2
I20260808 13:47:51.282575 18094 raft_consensus.cc:3060] T 32d60095c4d8478cb2ab130b29432265 P 48b0a4e36ef846cc9216bac13d6ae857 [term 2 FOLLOWER]: Advancing to term 3
I20260808 13:47:51.287333 18094 raft_consensus.cc:1275] T 32d60095c4d8478cb2ab130b29432265 P 48b0a4e36ef846cc9216bac13d6ae857 [term 3 FOLLOWER]: Refusing update from remote peer 87568a0bb8e84076bb0cd15dc4f25675: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260808 13:47:51.288630 18156 consensus_queue.cc:1048] T 32d60095c4d8478cb2ab130b29432265 P 87568a0bb8e84076bb0cd15dc4f25675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48b0a4e36ef846cc9216bac13d6ae857" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 39895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260808 13:47:51.442270 17263 tablet_server.cc:179] TabletServer@127.16.219.193:0 shutting down...
I20260808 13:47:51.459838 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 13:47:51.460399 17263 tablet_replica.cc:333] T 32d60095c4d8478cb2ab130b29432265 P 87568a0bb8e84076bb0cd15dc4f25675: stopping tablet replica
I20260808 13:47:51.460880 17263 raft_consensus.cc:2243] T 32d60095c4d8478cb2ab130b29432265 P 87568a0bb8e84076bb0cd15dc4f25675 [term 3 LEADER]: Raft consensus shutting down.
I20260808 13:47:51.461436 17263 raft_consensus.cc:2272] T 32d60095c4d8478cb2ab130b29432265 P 87568a0bb8e84076bb0cd15dc4f25675 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260808 13:47:51.469907 17263 tablet_server.cc:196] TabletServer@127.16.219.193:0 shutdown complete.
I20260808 13:47:51.477237 17263 tablet_server.cc:179] TabletServer@127.16.219.194:0 shutting down...
I20260808 13:47:51.492887 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 13:47:51.493433 17263 tablet_replica.cc:333] T 32d60095c4d8478cb2ab130b29432265 P 48b0a4e36ef846cc9216bac13d6ae857: stopping tablet replica
I20260808 13:47:51.493906 17263 raft_consensus.cc:2243] T 32d60095c4d8478cb2ab130b29432265 P 48b0a4e36ef846cc9216bac13d6ae857 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260808 13:47:51.494352 17263 raft_consensus.cc:2272] T 32d60095c4d8478cb2ab130b29432265 P 48b0a4e36ef846cc9216bac13d6ae857 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260808 13:47:51.512681 17263 tablet_server.cc:196] TabletServer@127.16.219.194:0 shutdown complete.
I20260808 13:47:51.520246 17263 master.cc:562] Master@127.16.219.254:43633 shutting down...
I20260808 13:47:51.534729 17263 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8db498a3eedc413d80e5b42607099525 [term 1 LEADER]: Raft consensus shutting down.
I20260808 13:47:51.535126 17263 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8db498a3eedc413d80e5b42607099525 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 13:47:51.535348 17263 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8db498a3eedc413d80e5b42607099525: stopping tablet replica
I20260808 13:47:51.551718 17263 master.cc:584] Master@127.16.219.254:43633 shutdown complete.
[ OK ] LeadershipChangeReportingTest.TestUpdatedConsensusState (2609 ms)
[----------] 3 tests from LeadershipChangeReportingTest (12559 ms total)
[----------] 4 tests from TsTabletManagerITest
[ RUN ] TsTabletManagerITest.ReportOnReplicaHealthStatus
I20260808 13:47:51.580331 17263 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.219.254:37525
I20260808 13:47:51.581338 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:47:51.585996 18165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:51.587112 18166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:51.588491 18168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:51.588956 17263 server_base.cc:1061] running on GCE node
I20260808 13:47:51.589607 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:47:51.589766 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:47:51.589883 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196871589868 us; error 0 us; skew 500 ppm
I20260808 13:47:51.590396 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:47:51.592438 17263 webserver.cc:533] Webserver started at http://127.16.219.254:45097/ using document root <none> and password file <none>
I20260808 13:47:51.592860 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:47:51.593006 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:47:51.593204 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:47:51.594254 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786196858807110-17263-0/minicluster-data/master-0-root/instance:
uuid: "21e5654b56d8489e81aefafcd2ad439c"
format_stamp: "Formatted at 2026-08-08 13:47:51 on dist-test-slave-mn4r"
I20260808 13:47:51.598491 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 13:47:51.601531 18173 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:51.602283 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 13:47:51.602569 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786196858807110-17263-0/minicluster-data/master-0-root
uuid: "21e5654b56d8489e81aefafcd2ad439c"
format_stamp: "Formatted at 2026-08-08 13:47:51 on dist-test-slave-mn4r"
I20260808 13:47:51.602857 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786196858807110-17263-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786196858807110-17263-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786196858807110-17263-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:47:51.626436 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:47:51.627586 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:47:51.664848 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.254:37525
I20260808 13:47:51.664923 18228 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.254:37525 every 8 connection(s)
I20260808 13:47:51.668577 18229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:47:51.678357 18229 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21e5654b56d8489e81aefafcd2ad439c: Bootstrap starting.
I20260808 13:47:51.682494 18229 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 21e5654b56d8489e81aefafcd2ad439c: Neither blocks nor log segments found. Creating new log.
I20260808 13:47:51.686328 18229 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21e5654b56d8489e81aefafcd2ad439c: No bootstrap required, opened a new log
I20260808 13:47:51.688265 18229 raft_consensus.cc:359] T 00000000000000000000000000000000 P 21e5654b56d8489e81aefafcd2ad439c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21e5654b56d8489e81aefafcd2ad439c" member_type: VOTER }
I20260808 13:47:51.688652 18229 raft_consensus.cc:385] T 00000000000000000000000000000000 P 21e5654b56d8489e81aefafcd2ad439c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:47:51.688895 18229 raft_consensus.cc:740] T 00000000000000000000000000000000 P 21e5654b56d8489e81aefafcd2ad439c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21e5654b56d8489e81aefafcd2ad439c, State: Initialized, Role: FOLLOWER
I20260808 13:47:51.689441 18229 consensus_queue.cc:260] T 00000000000000000000000000000000 P 21e5654b56d8489e81aefafcd2ad439c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21e5654b56d8489e81aefafcd2ad439c" member_type: VOTER }
I20260808 13:47:51.689860 18229 raft_consensus.cc:399] T 00000000000000000000000000000000 P 21e5654b56d8489e81aefafcd2ad439c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 13:47:51.690125 18229 raft_consensus.cc:493] T 00000000000000000000000000000000 P 21e5654b56d8489e81aefafcd2ad439c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 13:47:51.690374 18229 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 21e5654b56d8489e81aefafcd2ad439c [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:47:51.694424 18229 raft_consensus.cc:515] T 00000000000000000000000000000000 P 21e5654b56d8489e81aefafcd2ad439c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21e5654b56d8489e81aefafcd2ad439c" member_type: VOTER }
I20260808 13:47:51.694916 18229 leader_election.cc:304] T 00000000000000000000000000000000 P 21e5654b56d8489e81aefafcd2ad439c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 21e5654b56d8489e81aefafcd2ad439c; no voters:
I20260808 13:47:51.696030 18229 leader_election.cc:290] T 00000000000000000000000000000000 P 21e5654b56d8489e81aefafcd2ad439c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 13:47:51.696337 18232 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 21e5654b56d8489e81aefafcd2ad439c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 13:47:51.697739 18232 raft_consensus.cc:697] T 00000000000000000000000000000000 P 21e5654b56d8489e81aefafcd2ad439c [term 1 LEADER]: Becoming Leader. State: Replica: 21e5654b56d8489e81aefafcd2ad439c, State: Running, Role: LEADER
I20260808 13:47:51.698531 18232 consensus_queue.cc:237] T 00000000000000000000000000000000 P 21e5654b56d8489e81aefafcd2ad439c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21e5654b56d8489e81aefafcd2ad439c" member_type: VOTER }
I20260808 13:47:51.699195 18229 sys_catalog.cc:565] T 00000000000000000000000000000000 P 21e5654b56d8489e81aefafcd2ad439c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 13:47:51.701397 18233 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21e5654b56d8489e81aefafcd2ad439c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "21e5654b56d8489e81aefafcd2ad439c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21e5654b56d8489e81aefafcd2ad439c" member_type: VOTER } }
I20260808 13:47:51.701478 18234 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21e5654b56d8489e81aefafcd2ad439c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 21e5654b56d8489e81aefafcd2ad439c. Latest consensus state: current_term: 1 leader_uuid: "21e5654b56d8489e81aefafcd2ad439c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21e5654b56d8489e81aefafcd2ad439c" member_type: VOTER } }
I20260808 13:47:51.702106 18233 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21e5654b56d8489e81aefafcd2ad439c [sys.catalog]: This master's current role is: LEADER
I20260808 13:47:51.702147 18234 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21e5654b56d8489e81aefafcd2ad439c [sys.catalog]: This master's current role is: LEADER
I20260808 13:47:51.705159 18238 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 13:47:51.709970 18238 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 13:47:51.715407 17263 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260808 13:47:51.718519 18238 catalog_manager.cc:1383] Generated new cluster ID: ebf78ef0e97d473dafc2f2b3316cf605
I20260808 13:47:51.718732 18238 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 13:47:51.739007 18238 catalog_manager.cc:1406] Generated new certificate authority record
I20260808 13:47:51.740139 18238 catalog_manager.cc:1540] Loading token signing keys...
I20260808 13:47:51.752305 18238 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 21e5654b56d8489e81aefafcd2ad439c: Generated new TSK 0
I20260808 13:47:51.752799 18238 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 13:47:51.781740 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:47:51.787292 18252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:51.788383 18253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:51.789666 18255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:51.789945 17263 server_base.cc:1061] running on GCE node
I20260808 13:47:51.790874 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:47:51.791067 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:47:51.791251 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196871791219 us; error 0 us; skew 500 ppm
I20260808 13:47:51.791781 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:47:51.793962 17263 webserver.cc:533] Webserver started at http://127.16.219.193:46321/ using document root <none> and password file <none>
I20260808 13:47:51.794526 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:47:51.794742 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:47:51.795017 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:47:51.796092 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786196858807110-17263-0/minicluster-data/ts-0-root/instance:
uuid: "7a2efc5491064fb9a127baf3bc7020e4"
format_stamp: "Formatted at 2026-08-08 13:47:51 on dist-test-slave-mn4r"
I20260808 13:47:51.800637 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 13:47:51.803995 18260 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:51.804746 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 13:47:51.805084 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786196858807110-17263-0/minicluster-data/ts-0-root
uuid: "7a2efc5491064fb9a127baf3bc7020e4"
format_stamp: "Formatted at 2026-08-08 13:47:51 on dist-test-slave-mn4r"
I20260808 13:47:51.805337 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786196858807110-17263-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786196858807110-17263-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786196858807110-17263-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:47:51.822464 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:47:51.823448 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:47:51.824784 17263 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 13:47:51.826961 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 13:47:51.827139 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:51.827435 17263 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 13:47:51.827597 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:51.864964 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.193:41583
I20260808 13:47:51.865073 18331 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.193:41583 every 8 connection(s)
I20260808 13:47:51.869892 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:47:51.877132 18339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:51.879374 18340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:51.882063 18342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:51.884084 18332 heartbeater.cc:344] Connected to a master server at 127.16.219.254:37525
I20260808 13:47:51.884378 17263 server_base.cc:1061] running on GCE node
I20260808 13:47:51.884445 18332 heartbeater.cc:461] Registering TS with master...
I20260808 13:47:51.885390 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260808 13:47:51.885389 18332 heartbeater.cc:507] Master 127.16.219.254:37525 requested a full tablet report, sending...
W20260808 13:47:51.885777 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:47:51.885993 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196871885961 us; error 0 us; skew 500 ppm
I20260808 13:47:51.886624 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:47:51.887802 18192 ts_manager.cc:194] Registered new tserver with Master: 7a2efc5491064fb9a127baf3bc7020e4 (127.16.219.193:41583)
I20260808 13:47:51.889225 17263 webserver.cc:533] Webserver started at http://127.16.219.194:46863/ using document root <none> and password file <none>
I20260808 13:47:51.889647 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:47:51.889797 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:47:51.889822 18192 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40924
I20260808 13:47:51.890004 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:47:51.891422 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786196858807110-17263-0/minicluster-data/ts-1-root/instance:
uuid: "749489cfe3d4489e92256c4d865b7a06"
format_stamp: "Formatted at 2026-08-08 13:47:51 on dist-test-slave-mn4r"
I20260808 13:47:51.896088 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260808 13:47:51.899192 18347 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:51.899997 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260808 13:47:51.900318 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786196858807110-17263-0/minicluster-data/ts-1-root
uuid: "749489cfe3d4489e92256c4d865b7a06"
format_stamp: "Formatted at 2026-08-08 13:47:51 on dist-test-slave-mn4r"
I20260808 13:47:51.900658 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786196858807110-17263-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786196858807110-17263-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786196858807110-17263-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:47:51.916859 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:47:51.917852 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:47:51.919231 17263 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 13:47:51.921335 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 13:47:51.921550 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:51.921794 17263 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 13:47:51.921988 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:51.961740 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.194:40501
I20260808 13:47:51.961843 18416 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.194:40501 every 8 connection(s)
I20260808 13:47:51.966570 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:47:51.973943 18422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:51.976265 18423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:51.977442 18425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:51.978498 17263 server_base.cc:1061] running on GCE node
I20260808 13:47:51.979417 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260808 13:47:51.979427 18418 heartbeater.cc:344] Connected to a master server at 127.16.219.254:37525
W20260808 13:47:51.979734 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:47:51.979933 18418 heartbeater.cc:461] Registering TS with master...
I20260808 13:47:51.979938 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196871979921 us; error 0 us; skew 500 ppm
I20260808 13:47:51.980616 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:47:51.980703 18418 heartbeater.cc:507] Master 127.16.219.254:37525 requested a full tablet report, sending...
I20260808 13:47:51.982926 18192 ts_manager.cc:194] Registered new tserver with Master: 749489cfe3d4489e92256c4d865b7a06 (127.16.219.194:40501)
I20260808 13:47:51.983368 17263 webserver.cc:533] Webserver started at http://127.16.219.195:37479/ using document root <none> and password file <none>
I20260808 13:47:51.983856 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:47:51.984055 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:47:51.984314 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:47:51.984395 18192 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40926
I20260808 13:47:51.985525 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786196858807110-17263-0/minicluster-data/ts-2-root/instance:
uuid: "60b0ed9f0cf943cc9b2a339bed1c5649"
format_stamp: "Formatted at 2026-08-08 13:47:51 on dist-test-slave-mn4r"
I20260808 13:47:51.989991 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 13:47:51.993108 18430 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:51.993754 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 13:47:51.994022 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786196858807110-17263-0/minicluster-data/ts-2-root
uuid: "60b0ed9f0cf943cc9b2a339bed1c5649"
format_stamp: "Formatted at 2026-08-08 13:47:51 on dist-test-slave-mn4r"
I20260808 13:47:51.994325 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786196858807110-17263-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786196858807110-17263-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.ReportOnReplicaHealthStatus.1786196858807110-17263-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:47:52.009768 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:47:52.010797 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:47:52.012102 17263 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 13:47:52.014165 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 13:47:52.014381 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:52.014614 17263 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 13:47:52.014781 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:52.089021 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.195:41317
I20260808 13:47:52.089120 18499 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.195:41317 every 8 connection(s)
I20260808 13:47:52.104918 18500 heartbeater.cc:344] Connected to a master server at 127.16.219.254:37525
I20260808 13:47:52.105283 18500 heartbeater.cc:461] Registering TS with master...
I20260808 13:47:52.106181 18500 heartbeater.cc:507] Master 127.16.219.254:37525 requested a full tablet report, sending...
I20260808 13:47:52.108211 18192 ts_manager.cc:194] Registered new tserver with Master: 60b0ed9f0cf943cc9b2a339bed1c5649 (127.16.219.195:41317)
I20260808 13:47:52.108299 17263 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014546149s
I20260808 13:47:52.109675 18192 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40930
I20260808 13:47:52.132814 18192 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40938:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
}
}
W20260808 13:47:52.134258 18192 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 13:47:52.175148 18378 tablet_service.cc:1511] Processing CreateTablet for tablet 0ecec2b75d9e4f6a9d1deb22c98b7b3a (DEFAULT_TABLE table=test-table [id=f7f5f9e84c3a4fed809e5dcf7ec97b45]), partition=
I20260808 13:47:52.176314 18378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ecec2b75d9e4f6a9d1deb22c98b7b3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:47:52.178817 18461 tablet_service.cc:1511] Processing CreateTablet for tablet 0ecec2b75d9e4f6a9d1deb22c98b7b3a (DEFAULT_TABLE table=test-table [id=f7f5f9e84c3a4fed809e5dcf7ec97b45]), partition=
I20260808 13:47:52.179510 18292 tablet_service.cc:1511] Processing CreateTablet for tablet 0ecec2b75d9e4f6a9d1deb22c98b7b3a (DEFAULT_TABLE table=test-table [id=f7f5f9e84c3a4fed809e5dcf7ec97b45]), partition=
I20260808 13:47:52.179683 18461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ecec2b75d9e4f6a9d1deb22c98b7b3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:47:52.180591 18292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ecec2b75d9e4f6a9d1deb22c98b7b3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:47:52.193707 18518 tablet_bootstrap.cc:492] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 749489cfe3d4489e92256c4d865b7a06: Bootstrap starting.
I20260808 13:47:52.195199 18517 tablet_bootstrap.cc:492] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 60b0ed9f0cf943cc9b2a339bed1c5649: Bootstrap starting.
I20260808 13:47:52.200560 18518 tablet_bootstrap.cc:654] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 749489cfe3d4489e92256c4d865b7a06: Neither blocks nor log segments found. Creating new log.
I20260808 13:47:52.200664 18519 tablet_bootstrap.cc:492] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 7a2efc5491064fb9a127baf3bc7020e4: Bootstrap starting.
I20260808 13:47:52.203104 18517 tablet_bootstrap.cc:654] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 60b0ed9f0cf943cc9b2a339bed1c5649: Neither blocks nor log segments found. Creating new log.
I20260808 13:47:52.208510 18518 tablet_bootstrap.cc:492] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 749489cfe3d4489e92256c4d865b7a06: No bootstrap required, opened a new log
I20260808 13:47:52.208506 18517 tablet_bootstrap.cc:492] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 60b0ed9f0cf943cc9b2a339bed1c5649: No bootstrap required, opened a new log
I20260808 13:47:52.209023 18518 ts_tablet_manager.cc:1403] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 749489cfe3d4489e92256c4d865b7a06: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.005s
I20260808 13:47:52.209071 18517 ts_tablet_manager.cc:1403] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 60b0ed9f0cf943cc9b2a339bed1c5649: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.009s
I20260808 13:47:52.209564 18519 tablet_bootstrap.cc:654] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 7a2efc5491064fb9a127baf3bc7020e4: Neither blocks nor log segments found. Creating new log.
I20260808 13:47:52.211689 18518 raft_consensus.cc:359] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 749489cfe3d4489e92256c4d865b7a06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "749489cfe3d4489e92256c4d865b7a06" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 40501 } } peers { permanent_uuid: "7a2efc5491064fb9a127baf3bc7020e4" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 41583 } } peers { permanent_uuid: "60b0ed9f0cf943cc9b2a339bed1c5649" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 41317 } }
I20260808 13:47:52.212327 18518 raft_consensus.cc:385] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 749489cfe3d4489e92256c4d865b7a06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:47:52.212760 18518 raft_consensus.cc:740] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 749489cfe3d4489e92256c4d865b7a06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 749489cfe3d4489e92256c4d865b7a06, State: Initialized, Role: FOLLOWER
I20260808 13:47:52.212302 18517 raft_consensus.cc:359] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 60b0ed9f0cf943cc9b2a339bed1c5649 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "749489cfe3d4489e92256c4d865b7a06" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 40501 } } peers { permanent_uuid: "7a2efc5491064fb9a127baf3bc7020e4" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 41583 } } peers { permanent_uuid: "60b0ed9f0cf943cc9b2a339bed1c5649" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 41317 } }
I20260808 13:47:52.213253 18517 raft_consensus.cc:385] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 60b0ed9f0cf943cc9b2a339bed1c5649 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:47:52.213428 18518 consensus_queue.cc:260] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 749489cfe3d4489e92256c4d865b7a06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "749489cfe3d4489e92256c4d865b7a06" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 40501 } } peers { permanent_uuid: "7a2efc5491064fb9a127baf3bc7020e4" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 41583 } } peers { permanent_uuid: "60b0ed9f0cf943cc9b2a339bed1c5649" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 41317 } }
I20260808 13:47:52.213649 18517 raft_consensus.cc:740] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 60b0ed9f0cf943cc9b2a339bed1c5649 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60b0ed9f0cf943cc9b2a339bed1c5649, State: Initialized, Role: FOLLOWER
I20260808 13:47:52.214710 18517 consensus_queue.cc:260] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 60b0ed9f0cf943cc9b2a339bed1c5649 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "749489cfe3d4489e92256c4d865b7a06" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 40501 } } peers { permanent_uuid: "7a2efc5491064fb9a127baf3bc7020e4" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 41583 } } peers { permanent_uuid: "60b0ed9f0cf943cc9b2a339bed1c5649" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 41317 } }
I20260808 13:47:52.220970 18500 heartbeater.cc:499] Master 127.16.219.254:37525 was elected leader, sending a full tablet report...
I20260808 13:47:52.221230 18519 tablet_bootstrap.cc:492] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 7a2efc5491064fb9a127baf3bc7020e4: No bootstrap required, opened a new log
I20260808 13:47:52.222064 18418 heartbeater.cc:499] Master 127.16.219.254:37525 was elected leader, sending a full tablet report...
I20260808 13:47:52.222448 18518 ts_tablet_manager.cc:1434] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 749489cfe3d4489e92256c4d865b7a06: Time spent starting tablet: real 0.013s user 0.001s sys 0.013s
I20260808 13:47:52.223064 18517 ts_tablet_manager.cc:1434] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 60b0ed9f0cf943cc9b2a339bed1c5649: Time spent starting tablet: real 0.014s user 0.006s sys 0.006s
I20260808 13:47:52.221684 18519 ts_tablet_manager.cc:1403] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 7a2efc5491064fb9a127baf3bc7020e4: Time spent bootstrapping tablet: real 0.021s user 0.015s sys 0.004s
I20260808 13:47:52.225775 18519 raft_consensus.cc:359] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 7a2efc5491064fb9a127baf3bc7020e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "749489cfe3d4489e92256c4d865b7a06" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 40501 } } peers { permanent_uuid: "7a2efc5491064fb9a127baf3bc7020e4" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 41583 } } peers { permanent_uuid: "60b0ed9f0cf943cc9b2a339bed1c5649" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 41317 } }
I20260808 13:47:52.226362 18519 raft_consensus.cc:385] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 7a2efc5491064fb9a127baf3bc7020e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:47:52.226649 18519 raft_consensus.cc:740] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 7a2efc5491064fb9a127baf3bc7020e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a2efc5491064fb9a127baf3bc7020e4, State: Initialized, Role: FOLLOWER
I20260808 13:47:52.227315 18519 consensus_queue.cc:260] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 7a2efc5491064fb9a127baf3bc7020e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "749489cfe3d4489e92256c4d865b7a06" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 40501 } } peers { permanent_uuid: "7a2efc5491064fb9a127baf3bc7020e4" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 41583 } } peers { permanent_uuid: "60b0ed9f0cf943cc9b2a339bed1c5649" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 41317 } }
I20260808 13:47:52.230415 18332 heartbeater.cc:499] Master 127.16.219.254:37525 was elected leader, sending a full tablet report...
I20260808 13:47:52.230971 18519 ts_tablet_manager.cc:1434] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 7a2efc5491064fb9a127baf3bc7020e4: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260808 13:47:52.513371 18524 raft_consensus.cc:493] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 60b0ed9f0cf943cc9b2a339bed1c5649 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 13:47:52.513885 18524 raft_consensus.cc:515] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 60b0ed9f0cf943cc9b2a339bed1c5649 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "749489cfe3d4489e92256c4d865b7a06" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 40501 } } peers { permanent_uuid: "7a2efc5491064fb9a127baf3bc7020e4" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 41583 } } peers { permanent_uuid: "60b0ed9f0cf943cc9b2a339bed1c5649" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 41317 } }
I20260808 13:47:52.516163 18524 leader_election.cc:290] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 60b0ed9f0cf943cc9b2a339bed1c5649 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 749489cfe3d4489e92256c4d865b7a06 (127.16.219.194:40501), 7a2efc5491064fb9a127baf3bc7020e4 (127.16.219.193:41583)
I20260808 13:47:52.525069 18390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecec2b75d9e4f6a9d1deb22c98b7b3a" candidate_uuid: "60b0ed9f0cf943cc9b2a339bed1c5649" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "749489cfe3d4489e92256c4d865b7a06" is_pre_election: true
I20260808 13:47:52.525334 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecec2b75d9e4f6a9d1deb22c98b7b3a" candidate_uuid: "60b0ed9f0cf943cc9b2a339bed1c5649" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a2efc5491064fb9a127baf3bc7020e4" is_pre_election: true
I20260808 13:47:52.525882 18390 raft_consensus.cc:2468] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 749489cfe3d4489e92256c4d865b7a06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60b0ed9f0cf943cc9b2a339bed1c5649 in term 0.
I20260808 13:47:52.525972 18304 raft_consensus.cc:2468] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 7a2efc5491064fb9a127baf3bc7020e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60b0ed9f0cf943cc9b2a339bed1c5649 in term 0.
I20260808 13:47:52.527143 18435 leader_election.cc:304] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 60b0ed9f0cf943cc9b2a339bed1c5649 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60b0ed9f0cf943cc9b2a339bed1c5649, 749489cfe3d4489e92256c4d865b7a06; no voters:
I20260808 13:47:52.527827 18524 raft_consensus.cc:2804] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 60b0ed9f0cf943cc9b2a339bed1c5649 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 13:47:52.528153 18524 raft_consensus.cc:493] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 60b0ed9f0cf943cc9b2a339bed1c5649 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 13:47:52.528384 18524 raft_consensus.cc:3060] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 60b0ed9f0cf943cc9b2a339bed1c5649 [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:47:52.532980 18524 raft_consensus.cc:515] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 60b0ed9f0cf943cc9b2a339bed1c5649 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "749489cfe3d4489e92256c4d865b7a06" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 40501 } } peers { permanent_uuid: "7a2efc5491064fb9a127baf3bc7020e4" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 41583 } } peers { permanent_uuid: "60b0ed9f0cf943cc9b2a339bed1c5649" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 41317 } }
I20260808 13:47:52.534431 18524 leader_election.cc:290] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 60b0ed9f0cf943cc9b2a339bed1c5649 [CANDIDATE]: Term 1 election: Requested vote from peers 749489cfe3d4489e92256c4d865b7a06 (127.16.219.194:40501), 7a2efc5491064fb9a127baf3bc7020e4 (127.16.219.193:41583)
I20260808 13:47:52.535099 18390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecec2b75d9e4f6a9d1deb22c98b7b3a" candidate_uuid: "60b0ed9f0cf943cc9b2a339bed1c5649" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "749489cfe3d4489e92256c4d865b7a06"
I20260808 13:47:52.535435 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecec2b75d9e4f6a9d1deb22c98b7b3a" candidate_uuid: "60b0ed9f0cf943cc9b2a339bed1c5649" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a2efc5491064fb9a127baf3bc7020e4"
I20260808 13:47:52.535581 18390 raft_consensus.cc:3060] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 749489cfe3d4489e92256c4d865b7a06 [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:47:52.535923 18304 raft_consensus.cc:3060] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 7a2efc5491064fb9a127baf3bc7020e4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:47:52.540154 18390 raft_consensus.cc:2468] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 749489cfe3d4489e92256c4d865b7a06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60b0ed9f0cf943cc9b2a339bed1c5649 in term 1.
I20260808 13:47:52.540469 18304 raft_consensus.cc:2468] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 7a2efc5491064fb9a127baf3bc7020e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60b0ed9f0cf943cc9b2a339bed1c5649 in term 1.
I20260808 13:47:52.541188 18435 leader_election.cc:304] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 60b0ed9f0cf943cc9b2a339bed1c5649 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60b0ed9f0cf943cc9b2a339bed1c5649, 749489cfe3d4489e92256c4d865b7a06; no voters:
I20260808 13:47:52.541942 18524 raft_consensus.cc:2804] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 60b0ed9f0cf943cc9b2a339bed1c5649 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 13:47:52.542898 18524 raft_consensus.cc:697] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 60b0ed9f0cf943cc9b2a339bed1c5649 [term 1 LEADER]: Becoming Leader. State: Replica: 60b0ed9f0cf943cc9b2a339bed1c5649, State: Running, Role: LEADER
I20260808 13:47:52.543803 18524 consensus_queue.cc:237] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 60b0ed9f0cf943cc9b2a339bed1c5649 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "749489cfe3d4489e92256c4d865b7a06" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 40501 } } peers { permanent_uuid: "7a2efc5491064fb9a127baf3bc7020e4" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 41583 } } peers { permanent_uuid: "60b0ed9f0cf943cc9b2a339bed1c5649" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 41317 } }
I20260808 13:47:52.551878 18189 catalog_manager.cc:5697] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 60b0ed9f0cf943cc9b2a339bed1c5649 reported cstate change: term changed from 0 to 1, leader changed from <none> to 60b0ed9f0cf943cc9b2a339bed1c5649 (127.16.219.195). New cstate: current_term: 1 leader_uuid: "60b0ed9f0cf943cc9b2a339bed1c5649" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "749489cfe3d4489e92256c4d865b7a06" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 40501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a2efc5491064fb9a127baf3bc7020e4" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 41583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60b0ed9f0cf943cc9b2a339bed1c5649" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 41317 } health_report { overall_health: HEALTHY } } }
I20260808 13:47:52.978363 18524 consensus_queue.cc:1048] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 60b0ed9f0cf943cc9b2a339bed1c5649 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a2efc5491064fb9a127baf3bc7020e4" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 41583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 13:47:52.989499 18537 consensus_queue.cc:1048] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 60b0ed9f0cf943cc9b2a339bed1c5649 [LEADER]: Connected to new peer: Peer: permanent_uuid: "749489cfe3d4489e92256c4d865b7a06" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 40501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 13:47:53.689975 17263 tablet_replica.cc:333] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 7a2efc5491064fb9a127baf3bc7020e4: stopping tablet replica
I20260808 13:47:53.690580 17263 raft_consensus.cc:2243] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 7a2efc5491064fb9a127baf3bc7020e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 13:47:53.691016 17263 raft_consensus.cc:2272] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 7a2efc5491064fb9a127baf3bc7020e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 13:47:53.889125 18432 consensus_queue.cc:579] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 60b0ed9f0cf943cc9b2a339bed1c5649 [LEADER]: The tablet replica hosted on peer 7a2efc5491064fb9a127baf3bc7020e4 has failed
W20260808 13:47:53.889727 18432 consensus_peers.cc:597] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 60b0ed9f0cf943cc9b2a339bed1c5649 -> Peer 7a2efc5491064fb9a127baf3bc7020e4 (127.16.219.193:41583): Couldn't send request to peer 7a2efc5491064fb9a127baf3bc7020e4. Error code: TABLET_FAILED (20). Status: Illegal state: Tablet not RUNNING: FAILED: IO error: INJECTED ERROR: tablet failed. This is attempt 1: this message will repeat every 5th retry.
I20260808 13:47:53.957419 17263 tablet_server.cc:179] TabletServer@127.16.219.193:0 shutting down...
I20260808 13:47:53.975600 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 13:47:53.992458 17263 tablet_server.cc:196] TabletServer@127.16.219.193:0 shutdown complete.
I20260808 13:47:54.000516 17263 tablet_server.cc:179] TabletServer@127.16.219.194:0 shutting down...
I20260808 13:47:54.017120 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 13:47:54.017760 17263 tablet_replica.cc:333] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 749489cfe3d4489e92256c4d865b7a06: stopping tablet replica
I20260808 13:47:54.018352 17263 raft_consensus.cc:2243] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 749489cfe3d4489e92256c4d865b7a06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 13:47:54.018765 17263 raft_consensus.cc:2272] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 749489cfe3d4489e92256c4d865b7a06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 13:47:54.026504 17263 tablet_server.cc:196] TabletServer@127.16.219.194:0 shutdown complete.
I20260808 13:47:54.033844 17263 tablet_server.cc:179] TabletServer@127.16.219.195:0 shutting down...
I20260808 13:47:54.049971 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 13:47:54.050585 17263 tablet_replica.cc:333] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 60b0ed9f0cf943cc9b2a339bed1c5649: stopping tablet replica
I20260808 13:47:54.051051 17263 raft_consensus.cc:2243] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 60b0ed9f0cf943cc9b2a339bed1c5649 [term 1 LEADER]: Raft consensus shutting down.
I20260808 13:47:54.051797 17263 raft_consensus.cc:2272] T 0ecec2b75d9e4f6a9d1deb22c98b7b3a P 60b0ed9f0cf943cc9b2a339bed1c5649 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 13:47:54.069336 17263 tablet_server.cc:196] TabletServer@127.16.219.195:0 shutdown complete.
I20260808 13:47:54.076812 17263 master.cc:562] Master@127.16.219.254:37525 shutting down...
I20260808 13:47:54.090410 17263 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 21e5654b56d8489e81aefafcd2ad439c [term 1 LEADER]: Raft consensus shutting down.
I20260808 13:47:54.090914 17263 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 21e5654b56d8489e81aefafcd2ad439c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 13:47:54.091200 17263 tablet_replica.cc:333] T 00000000000000000000000000000000 P 21e5654b56d8489e81aefafcd2ad439c: stopping tablet replica
I20260808 13:47:54.108327 17263 master.cc:584] Master@127.16.219.254:37525 shutdown complete.
[ OK ] TsTabletManagerITest.ReportOnReplicaHealthStatus (2552 ms)
[ RUN ] TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters
I20260808 13:47:54.133438 17263 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.219.254:43421
I20260808 13:47:54.134596 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:47:54.139134 18549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:54.140623 18550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:54.142139 18552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:54.142885 17263 server_base.cc:1061] running on GCE node
I20260808 13:47:54.143605 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:47:54.143790 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:47:54.143944 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196874143913 us; error 0 us; skew 500 ppm
I20260808 13:47:54.144445 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:47:54.146828 17263 webserver.cc:533] Webserver started at http://127.16.219.254:37231/ using document root <none> and password file <none>
I20260808 13:47:54.147311 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:47:54.147511 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:47:54.147782 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:47:54.148944 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786196858807110-17263-0/minicluster-data/master-0-root/instance:
uuid: "9658b25aceae45278a1e017191a96837"
format_stamp: "Formatted at 2026-08-08 13:47:54 on dist-test-slave-mn4r"
I20260808 13:47:54.153285 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 13:47:54.156433 18559 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:54.157152 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 13:47:54.157439 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786196858807110-17263-0/minicluster-data/master-0-root
uuid: "9658b25aceae45278a1e017191a96837"
format_stamp: "Formatted at 2026-08-08 13:47:54 on dist-test-slave-mn4r"
I20260808 13:47:54.157707 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786196858807110-17263-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786196858807110-17263-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786196858807110-17263-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:47:54.169934 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:47:54.170993 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:47:54.207401 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.254:43421
I20260808 13:47:54.207502 18612 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.254:43421 every 8 connection(s)
I20260808 13:47:54.211249 18613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:47:54.220865 18613 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9658b25aceae45278a1e017191a96837: Bootstrap starting.
I20260808 13:47:54.225227 18613 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9658b25aceae45278a1e017191a96837: Neither blocks nor log segments found. Creating new log.
I20260808 13:47:54.229005 18613 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9658b25aceae45278a1e017191a96837: No bootstrap required, opened a new log
I20260808 13:47:54.231057 18613 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9658b25aceae45278a1e017191a96837 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9658b25aceae45278a1e017191a96837" member_type: VOTER }
I20260808 13:47:54.231456 18613 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9658b25aceae45278a1e017191a96837 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:47:54.231637 18613 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9658b25aceae45278a1e017191a96837 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9658b25aceae45278a1e017191a96837, State: Initialized, Role: FOLLOWER
I20260808 13:47:54.232175 18613 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9658b25aceae45278a1e017191a96837 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9658b25aceae45278a1e017191a96837" member_type: VOTER }
I20260808 13:47:54.232586 18613 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9658b25aceae45278a1e017191a96837 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 13:47:54.232771 18613 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9658b25aceae45278a1e017191a96837 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 13:47:54.232975 18613 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9658b25aceae45278a1e017191a96837 [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:47:54.236842 18613 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9658b25aceae45278a1e017191a96837 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9658b25aceae45278a1e017191a96837" member_type: VOTER }
I20260808 13:47:54.237272 18613 leader_election.cc:304] T 00000000000000000000000000000000 P 9658b25aceae45278a1e017191a96837 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9658b25aceae45278a1e017191a96837; no voters:
I20260808 13:47:54.238453 18613 leader_election.cc:290] T 00000000000000000000000000000000 P 9658b25aceae45278a1e017191a96837 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 13:47:54.238744 18618 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9658b25aceae45278a1e017191a96837 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 13:47:54.240216 18618 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9658b25aceae45278a1e017191a96837 [term 1 LEADER]: Becoming Leader. State: Replica: 9658b25aceae45278a1e017191a96837, State: Running, Role: LEADER
I20260808 13:47:54.240835 18618 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9658b25aceae45278a1e017191a96837 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9658b25aceae45278a1e017191a96837" member_type: VOTER }
I20260808 13:47:54.241305 18613 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9658b25aceae45278a1e017191a96837 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 13:47:54.243882 18620 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9658b25aceae45278a1e017191a96837 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9658b25aceae45278a1e017191a96837. Latest consensus state: current_term: 1 leader_uuid: "9658b25aceae45278a1e017191a96837" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9658b25aceae45278a1e017191a96837" member_type: VOTER } }
I20260808 13:47:54.243839 18619 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9658b25aceae45278a1e017191a96837 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9658b25aceae45278a1e017191a96837" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9658b25aceae45278a1e017191a96837" member_type: VOTER } }
I20260808 13:47:54.244509 18620 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9658b25aceae45278a1e017191a96837 [sys.catalog]: This master's current role is: LEADER
I20260808 13:47:54.244642 18619 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9658b25aceae45278a1e017191a96837 [sys.catalog]: This master's current role is: LEADER
I20260808 13:47:54.248200 18624 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 13:47:54.252835 18624 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 13:47:54.258252 17263 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260808 13:47:54.262312 18624 catalog_manager.cc:1383] Generated new cluster ID: 18b5d2306855440a8ef33292e7b5f301
I20260808 13:47:54.262588 18624 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 13:47:54.280247 18624 catalog_manager.cc:1406] Generated new certificate authority record
I20260808 13:47:54.281499 18624 catalog_manager.cc:1540] Loading token signing keys...
I20260808 13:47:54.291307 18624 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9658b25aceae45278a1e017191a96837: Generated new TSK 0
I20260808 13:47:54.291868 18624 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 13:47:54.325480 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:47:54.331354 18637 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:54.332835 18638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:54.335441 17263 server_base.cc:1061] running on GCE node
W20260808 13:47:54.335557 18642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:54.337579 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:47:54.337793 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:47:54.337967 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196874337950 us; error 0 us; skew 500 ppm
I20260808 13:47:54.338557 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:47:54.340927 17263 webserver.cc:533] Webserver started at http://127.16.219.193:38903/ using document root <none> and password file <none>
I20260808 13:47:54.341415 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:47:54.341638 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:47:54.341918 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:47:54.343070 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786196858807110-17263-0/minicluster-data/ts-0-root/instance:
uuid: "d6712d2d6bdf4f4ca7496656bab91729"
format_stamp: "Formatted at 2026-08-08 13:47:54 on dist-test-slave-mn4r"
I20260808 13:47:54.347837 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 13:47:54.351081 18648 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:54.351960 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 13:47:54.352198 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786196858807110-17263-0/minicluster-data/ts-0-root
uuid: "d6712d2d6bdf4f4ca7496656bab91729"
format_stamp: "Formatted at 2026-08-08 13:47:54 on dist-test-slave-mn4r"
I20260808 13:47:54.352480 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786196858807110-17263-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786196858807110-17263-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786196858807110-17263-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:47:54.394833 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:47:54.395967 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:47:54.397399 17263 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 13:47:54.399709 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 13:47:54.399927 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:54.400206 17263 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 13:47:54.400383 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:54.439890 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.193:36445
I20260808 13:47:54.440021 18717 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.193:36445 every 8 connection(s)
I20260808 13:47:54.454707 18718 heartbeater.cc:344] Connected to a master server at 127.16.219.254:43421
I20260808 13:47:54.455111 18718 heartbeater.cc:461] Registering TS with master...
I20260808 13:47:54.455781 18718 heartbeater.cc:507] Master 127.16.219.254:43421 requested a full tablet report, sending...
I20260808 13:47:54.457669 18576 ts_manager.cc:194] Registered new tserver with Master: d6712d2d6bdf4f4ca7496656bab91729 (127.16.219.193:36445)
I20260808 13:47:54.458247 17263 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.015002287s
I20260808 13:47:54.460078 18576 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44542
I20260808 13:47:54.478283 17263 tablet_server.cc:179] TabletServer@127.16.219.193:0 shutting down...
I20260808 13:47:54.493826 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 13:47:54.509321 17263 tablet_server.cc:196] TabletServer@127.16.219.193:0 shutdown complete.
I20260808 13:47:54.516767 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260808 13:47:54.519618 17263 tablet_server.cc:94] deduplicated master addresses: 127.16.219.254:43421
W20260808 13:47:54.522924 18729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:54.523136 18731 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:54.524420 18733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:54.525292 17263 server_base.cc:1061] running on GCE node
I20260808 13:47:54.526203 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:47:54.526378 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:47:54.526504 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196874526486 us; error 0 us; skew 500 ppm
I20260808 13:47:54.526947 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:47:54.529008 17263 webserver.cc:533] Webserver started at http://127.16.219.193:38903/ using document root <none> and password file <none>
I20260808 13:47:54.529464 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:47:54.529641 17263 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260808 13:47:54.533190 17263 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 13:47:54.535703 18738 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:54.536414 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 13:47:54.536653 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786196858807110-17263-0/minicluster-data/ts-0-root
uuid: "d6712d2d6bdf4f4ca7496656bab91729"
format_stamp: "Formatted at 2026-08-08 13:47:54 on dist-test-slave-mn4r"
I20260808 13:47:54.536902 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786196858807110-17263-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786196858807110-17263-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters.1786196858807110-17263-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:47:54.549717 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:47:54.550639 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:47:54.551892 17263 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 13:47:54.554133 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 13:47:54.554316 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:54.554595 17263 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 13:47:54.554746 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:54.591995 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.193:36445
I20260808 13:47:54.592103 18808 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.193:36445 every 8 connection(s)
I20260808 13:47:54.597152 17263 tablet_server.cc:179] TabletServer@127.16.219.193:36445 shutting down...
I20260808 13:47:54.611937 18809 heartbeater.cc:344] Connected to a master server at 127.16.219.254:43421
I20260808 13:47:54.612381 18809 heartbeater.cc:461] Registering TS with master...
I20260808 13:47:54.613306 18809 heartbeater.cc:507] Master 127.16.219.254:43421 requested a full tablet report, sending...
I20260808 13:47:54.616964 18576 ts_manager.cc:194] Re-registered known tserver with Master: d6712d2d6bdf4f4ca7496656bab91729 (127.16.219.193:36445)
I20260808 13:47:54.618602 18576 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44564
I20260808 13:47:54.620973 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 13:47:54.636196 17263 tablet_server.cc:196] TabletServer@127.16.219.193:36445 shutdown complete.
I20260808 13:47:54.643337 17263 master.cc:562] Master@127.16.219.254:43421 shutting down...
I20260808 13:47:54.658268 17263 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9658b25aceae45278a1e017191a96837 [term 1 LEADER]: Raft consensus shutting down.
I20260808 13:47:54.658704 17263 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9658b25aceae45278a1e017191a96837 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 13:47:54.659067 17263 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9658b25aceae45278a1e017191a96837: stopping tablet replica
I20260808 13:47:54.677366 17263 master.cc:584] Master@127.16.219.254:43421 shutdown complete.
[ OK ] TsTabletManagerITest.TestDeduplicateMasterAddrsForHeartbeaters (565 ms)
[ RUN ] TsTabletManagerITest.TestTableStats
I20260808 13:47:54.699389 17263 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.219.254:37813,127.16.219.253:44897,127.16.219.252:36493
I20260808 13:47:54.700783 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:47:54.705294 18816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:54.706439 18817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:54.707845 18819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:54.708420 17263 server_base.cc:1061] running on GCE node
I20260808 13:47:54.709141 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:47:54.709323 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:47:54.709491 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196874709461 us; error 0 us; skew 500 ppm
I20260808 13:47:54.710021 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:47:54.712263 17263 webserver.cc:533] Webserver started at http://127.16.219.254:32993/ using document root <none> and password file <none>
I20260808 13:47:54.712723 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:47:54.712908 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:47:54.713167 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:47:54.714303 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/master-0-root/instance:
uuid: "b5e2d9219789424c809f622aff07d3f7"
format_stamp: "Formatted at 2026-08-08 13:47:54 on dist-test-slave-mn4r"
I20260808 13:47:54.718719 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 13:47:54.721767 18824 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:54.722482 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 13:47:54.722755 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/master-0-root
uuid: "b5e2d9219789424c809f622aff07d3f7"
format_stamp: "Formatted at 2026-08-08 13:47:54 on dist-test-slave-mn4r"
I20260808 13:47:54.723076 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:47:54.734706 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:47:54.735662 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:47:54.771082 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.254:37813
I20260808 13:47:54.771188 18879 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.254:37813 every 8 connection(s)
I20260808 13:47:54.774874 18880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:47:54.775163 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:47:54.780369 18882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:54.781965 18884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:54.782460 18880 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } has no permanent_uuid. Determining permanent_uuid...
W20260808 13:47:54.783402 18887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:54.784538 17263 server_base.cc:1061] running on GCE node
I20260808 13:47:54.785354 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:47:54.785609 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:47:54.785877 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196874785854 us; error 0 us; skew 500 ppm
I20260808 13:47:54.786666 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:47:54.789618 17263 webserver.cc:533] Webserver started at http://127.16.219.253:37401/ using document root <none> and password file <none>
I20260808 13:47:54.790136 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:47:54.790323 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:47:54.790585 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:47:54.791612 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/master-1-root/instance:
uuid: "c8034ed4c5804b538b25282ddf38e46e"
format_stamp: "Formatted at 2026-08-08 13:47:54 on dist-test-slave-mn4r"
I20260808 13:47:54.795954 18880 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } has no permanent_uuid. Determining permanent_uuid...
I20260808 13:47:54.797083 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
W20260808 13:47:54.798751 18826 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.219.253:44897: connect: Connection refused (error 111)
I20260808 13:47:54.801214 18896 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:54.802070 17263 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 13:47:54.802393 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/master-1-root
uuid: "c8034ed4c5804b538b25282ddf38e46e"
format_stamp: "Formatted at 2026-08-08 13:47:54 on dist-test-slave-mn4r"
W20260808 13:47:54.802523 18880 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.219.253:44897: Network error: Client connection negotiation failed: client connection to 127.16.219.253:44897: connect: Connection refused (error 111)
I20260808 13:47:54.802732 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/master-1-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/master-1-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/master-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:47:54.819986 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:47:54.820927 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:47:54.854101 18880 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } attempt: 1
I20260808 13:47:54.858052 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.253:44897
I20260808 13:47:54.858240 18953 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.253:44897 every 8 connection(s)
I20260808 13:47:54.863082 18955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:47:54.863622 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260808 13:47:54.872587 18880 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } has no permanent_uuid. Determining permanent_uuid...
I20260808 13:47:54.873070 18955 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } has no permanent_uuid. Determining permanent_uuid...
W20260808 13:47:54.870428 18957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:54.879529 18958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:54.882041 18960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:54.883061 18880 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.219.252:36493: Network error: Client connection negotiation failed: client connection to 127.16.219.252:36493: connect: Connection refused (error 111)
I20260808 13:47:54.884756 17263 server_base.cc:1061] running on GCE node
I20260808 13:47:54.885563 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:47:54.885788 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:47:54.885978 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196874885961 us; error 0 us; skew 500 ppm
I20260808 13:47:54.886539 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:47:54.889328 17263 webserver.cc:533] Webserver started at http://127.16.219.252:41281/ using document root <none> and password file <none>
I20260808 13:47:54.889895 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:47:54.890138 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:47:54.890429 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:47:54.891677 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/master-2-root/instance:
uuid: "43efdd0c2d224907a532c8f81d469c60"
format_stamp: "Formatted at 2026-08-08 13:47:54 on dist-test-slave-mn4r"
I20260808 13:47:54.892674 18955 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } has no permanent_uuid. Determining permanent_uuid...
I20260808 13:47:54.897439 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260808 13:47:54.901142 18968 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:54.902060 17263 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 13:47:54.902412 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/master-2-root
uuid: "43efdd0c2d224907a532c8f81d469c60"
format_stamp: "Formatted at 2026-08-08 13:47:54 on dist-test-slave-mn4r"
I20260808 13:47:54.902652 18955 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } has no permanent_uuid. Determining permanent_uuid...
I20260808 13:47:54.902688 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260808 13:47:54.908546 18955 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.219.252:36493: Network error: Client connection negotiation failed: client connection to 127.16.219.252:36493: connect: Connection refused (error 111)
I20260808 13:47:54.917757 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:47:54.918871 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:47:54.926952 18955 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } attempt: 1
I20260808 13:47:54.928666 18880 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } attempt: 1
W20260808 13:47:54.932319 18955 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.219.252:36493: Network error: Client connection negotiation failed: client connection to 127.16.219.252:36493: connect: Connection refused (error 111)
W20260808 13:47:54.935511 18880 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.219.252:36493: Network error: Client connection negotiation failed: client connection to 127.16.219.252:36493: connect: Connection refused (error 111)
I20260808 13:47:54.957865 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.252:36493
I20260808 13:47:54.957973 19026 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.252:36493 every 8 connection(s)
I20260808 13:47:54.960948 17263 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260808 13:47:54.961550 19027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:47:54.967144 19027 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } has no permanent_uuid. Determining permanent_uuid...
I20260808 13:47:54.976305 18880 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } attempt: 2
I20260808 13:47:54.978292 19027 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } has no permanent_uuid. Determining permanent_uuid...
I20260808 13:47:54.986877 18955 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } attempt: 2
I20260808 13:47:54.989563 19027 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } has no permanent_uuid. Determining permanent_uuid...
I20260808 13:47:54.996959 18880 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7: Bootstrap starting.
I20260808 13:47:55.002943 18880 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7: Neither blocks nor log segments found. Creating new log.
I20260808 13:47:55.006228 18955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e: Bootstrap starting.
I20260808 13:47:55.007496 18880 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7: No bootstrap required, opened a new log
I20260808 13:47:55.008843 19027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60: Bootstrap starting.
I20260808 13:47:55.009637 18880 raft_consensus.cc:359] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:47:55.010210 18880 raft_consensus.cc:385] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:47:55.010473 18880 raft_consensus.cc:740] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5e2d9219789424c809f622aff07d3f7, State: Initialized, Role: FOLLOWER
I20260808 13:47:55.011127 18880 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:47:55.012554 18955 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e: Neither blocks nor log segments found. Creating new log.
I20260808 13:47:55.013021 19034 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:55.013839 19034 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 13:47:55.014596 18880 sys_catalog.cc:565] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 13:47:55.014997 19027 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60: Neither blocks nor log segments found. Creating new log.
I20260808 13:47:55.017998 18955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e: No bootstrap required, opened a new log
I20260808 13:47:55.020737 19027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60: No bootstrap required, opened a new log
I20260808 13:47:55.020545 18955 raft_consensus.cc:359] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:47:55.021347 18955 raft_consensus.cc:385] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:47:55.021435 19034 raft_consensus.cc:493] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 13:47:55.021721 18955 raft_consensus.cc:740] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8034ed4c5804b538b25282ddf38e46e, State: Initialized, Role: FOLLOWER
I20260808 13:47:55.022104 19034 raft_consensus.cc:515] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:47:55.022657 18955 consensus_queue.cc:260] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:47:55.023520 19027 raft_consensus.cc:359] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:47:55.024330 19027 raft_consensus.cc:385] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:47:55.024673 19027 raft_consensus.cc:740] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43efdd0c2d224907a532c8f81d469c60, State: Initialized, Role: FOLLOWER
I20260808 13:47:55.024843 19034 leader_election.cc:290] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8034ed4c5804b538b25282ddf38e46e (127.16.219.253:44897), 43efdd0c2d224907a532c8f81d469c60 (127.16.219.252:36493)
I20260808 13:47:55.025681 19027 consensus_queue.cc:260] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:47:55.030941 19027 sys_catalog.cc:565] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 13:47:55.029819 19044 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:55.031033 18999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e2d9219789424c809f622aff07d3f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43efdd0c2d224907a532c8f81d469c60" is_pre_election: true
I20260808 13:47:55.031580 19044 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 13:47:55.031755 18999 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5e2d9219789424c809f622aff07d3f7 in term 0.
I20260808 13:47:55.033438 18828 leader_election.cc:304] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43efdd0c2d224907a532c8f81d469c60, b5e2d9219789424c809f622aff07d3f7; no voters:
I20260808 13:47:55.034695 19034 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 13:47:55.035148 19034 raft_consensus.cc:493] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 13:47:55.035606 19034 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:47:55.035413 19043 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:55.036211 19043 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: This master's current role is: FOLLOWER
I20260808 13:47:55.037021 18925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e2d9219789424c809f622aff07d3f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8034ed4c5804b538b25282ddf38e46e" is_pre_election: true
I20260808 13:47:55.037834 18925 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5e2d9219789424c809f622aff07d3f7 in term 0.
I20260808 13:47:55.036815 18955 sys_catalog.cc:565] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 13:47:55.044670 19034 raft_consensus.cc:515] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:47:55.048676 19034 leader_election.cc:290] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [CANDIDATE]: Term 1 election: Requested vote from peers c8034ed4c5804b538b25282ddf38e46e (127.16.219.253:44897), 43efdd0c2d224907a532c8f81d469c60 (127.16.219.252:36493)
I20260808 13:47:55.049525 18999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e2d9219789424c809f622aff07d3f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43efdd0c2d224907a532c8f81d469c60"
I20260808 13:47:55.050267 18999 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:47:55.048588 18925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e2d9219789424c809f622aff07d3f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8034ed4c5804b538b25282ddf38e46e"
I20260808 13:47:55.054418 18925 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:47:55.062532 18999 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5e2d9219789424c809f622aff07d3f7 in term 1.
I20260808 13:47:55.064254 18828 leader_election.cc:304] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43efdd0c2d224907a532c8f81d469c60, b5e2d9219789424c809f622aff07d3f7; no voters:
I20260808 13:47:55.065402 19034 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 13:47:55.065908 18925 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5e2d9219789424c809f622aff07d3f7 in term 1.
I20260808 13:47:55.070060 19034 raft_consensus.cc:697] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 1 LEADER]: Becoming Leader. State: Replica: b5e2d9219789424c809f622aff07d3f7, State: Running, Role: LEADER
I20260808 13:47:55.074738 19034 consensus_queue.cc:237] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:47:55.090489 19053 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5e2d9219789424c809f622aff07d3f7. Latest consensus state: current_term: 1 leader_uuid: "b5e2d9219789424c809f622aff07d3f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:55.091549 19053 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: This master's current role is: LEADER
I20260808 13:47:55.098173 19071 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
W20260808 13:47:55.106587 19073 catalog_manager.cc:1594] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 13:47:55.106892 19073 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 13:47:55.112782 17263 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 1
I20260808 13:47:55.113101 17263 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 2
I20260808 13:47:55.113917 19071 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 13:47:55.121910 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260808 13:47:55.123116 18999 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 1 FOLLOWER]: Refusing update from remote peer b5e2d9219789424c809f622aff07d3f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 13:47:55.123112 18925 raft_consensus.cc:1275] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 1 FOLLOWER]: Refusing update from remote peer b5e2d9219789424c809f622aff07d3f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
E20260808 13:47:55.124375 17263 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
I20260808 13:47:55.125226 19034 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 13:47:55.126070 19081 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 13:47:55.126431 19081 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 13:47:55.126264 19053 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 13:47:55.132882 19082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:55.141183 19085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:55.143698 19043 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5e2d9219789424c809f622aff07d3f7. Latest consensus state: current_term: 1 leader_uuid: "b5e2d9219789424c809f622aff07d3f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:55.144472 19043 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: This master's current role is: FOLLOWER
W20260808 13:47:55.148085 19092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:55.148391 19079 mvcc.cc:204] Tried to move back new op lower bound from 7316262400489971712 to 7316262400321699840. Current Snapshot: MvccSnapshot[applied={T|T < 7316262400489971712}]
I20260808 13:47:55.149446 19034 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b5e2d9219789424c809f622aff07d3f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:55.149621 19044 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5e2d9219789424c809f622aff07d3f7. Latest consensus state: current_term: 1 leader_uuid: "b5e2d9219789424c809f622aff07d3f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:55.150354 19034 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: This master's current role is: LEADER
I20260808 13:47:55.150418 19044 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 13:47:55.152019 17263 server_base.cc:1061] running on GCE node
I20260808 13:47:55.152447 19071 catalog_manager.cc:1383] Generated new cluster ID: 89ddcd6e6f434b32a06787e9c40e4160
I20260808 13:47:55.152792 19071 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 13:47:55.153527 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:47:55.153803 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:47:55.154024 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196875154005 us; error 0 us; skew 500 ppm
I20260808 13:47:55.154848 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:47:55.155928 19043 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b5e2d9219789424c809f622aff07d3f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:55.156592 19043 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: This master's current role is: FOLLOWER
I20260808 13:47:55.157469 19034 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b5e2d9219789424c809f622aff07d3f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:55.158390 19034 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: This master's current role is: LEADER
I20260808 13:47:55.176084 19044 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b5e2d9219789424c809f622aff07d3f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:55.176901 19044 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 13:47:55.178522 17263 webserver.cc:533] Webserver started at http://127.16.219.193:38543/ using document root <none> and password file <none>
I20260808 13:47:55.179122 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:47:55.179351 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:47:55.179632 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:47:55.181089 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/ts-0-root/instance:
uuid: "de942a19327e426b994b416686c1412a"
format_stamp: "Formatted at 2026-08-08 13:47:55 on dist-test-slave-mn4r"
I20260808 13:47:55.190418 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.006s sys 0.000s
I20260808 13:47:55.190785 19071 catalog_manager.cc:1406] Generated new certificate authority record
I20260808 13:47:55.192436 19071 catalog_manager.cc:1540] Loading token signing keys...
I20260808 13:47:55.194839 19101 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:55.195747 17263 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 13:47:55.196043 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/ts-0-root
uuid: "de942a19327e426b994b416686c1412a"
format_stamp: "Formatted at 2026-08-08 13:47:55 on dist-test-slave-mn4r"
I20260808 13:47:55.196364 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:47:55.211897 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:47:55.213008 19071 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7: Generated new TSK 0
I20260808 13:47:55.213322 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:47:55.213774 19071 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 13:47:55.215500 17263 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 13:47:55.218494 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 13:47:55.218664 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:55.218946 17263 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 13:47:55.219112 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:55.261790 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.193:40615
I20260808 13:47:55.261899 19171 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.193:40615 every 8 connection(s)
I20260808 13:47:55.278873 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260808 13:47:55.281378 17263 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260808 13:47:55.294807 19180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:55.296690 19181 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:55.305390 19172 heartbeater.cc:344] Connected to a master server at 127.16.219.252:36493
I20260808 13:47:55.305776 19172 heartbeater.cc:461] Registering TS with master...
I20260808 13:47:55.306607 19172 heartbeater.cc:507] Master 127.16.219.252:36493 requested a full tablet report, sending...
I20260808 13:47:55.308701 17263 server_base.cc:1061] running on GCE node
W20260808 13:47:55.310616 19183 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:55.310847 18986 ts_manager.cc:194] Registered new tserver with Master: de942a19327e426b994b416686c1412a (127.16.219.193:40615)
I20260808 13:47:55.311717 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:47:55.312062 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:47:55.312321 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196875312302 us; error 0 us; skew 500 ppm
I20260808 13:47:55.313054 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:47:55.316300 19173 heartbeater.cc:344] Connected to a master server at 127.16.219.253:44897
I20260808 13:47:55.316664 19173 heartbeater.cc:461] Registering TS with master...
I20260808 13:47:55.317533 19173 heartbeater.cc:507] Master 127.16.219.253:44897 requested a full tablet report, sending...
I20260808 13:47:55.319458 17263 webserver.cc:533] Webserver started at http://127.16.219.194:34503/ using document root <none> and password file <none>
I20260808 13:47:55.319530 19175 heartbeater.cc:344] Connected to a master server at 127.16.219.254:37813
I20260808 13:47:55.320014 19175 heartbeater.cc:461] Registering TS with master...
I20260808 13:47:55.320225 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:47:55.320544 18914 ts_manager.cc:194] Registered new tserver with Master: de942a19327e426b994b416686c1412a (127.16.219.193:40615)
I20260808 13:47:55.320580 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:47:55.320906 19175 heartbeater.cc:507] Master 127.16.219.254:37813 requested a full tablet report, sending...
I20260808 13:47:55.321072 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:47:55.322476 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/ts-1-root/instance:
uuid: "d00890937b5046758a2fb3cd9c79e8ad"
format_stamp: "Formatted at 2026-08-08 13:47:55 on dist-test-slave-mn4r"
I20260808 13:47:55.323338 18841 ts_manager.cc:194] Registered new tserver with Master: de942a19327e426b994b416686c1412a (127.16.219.193:40615)
I20260808 13:47:55.325219 18841 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37238
I20260808 13:47:55.328016 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 13:47:55.331821 19188 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:55.332665 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260808 13:47:55.332944 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/ts-1-root
uuid: "d00890937b5046758a2fb3cd9c79e8ad"
format_stamp: "Formatted at 2026-08-08 13:47:55 on dist-test-slave-mn4r"
I20260808 13:47:55.333240 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:47:55.350400 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:47:55.352293 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:47:55.354692 17263 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 13:47:55.357507 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 13:47:55.357808 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:55.358141 17263 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 13:47:55.358327 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260808 13:47:55.427917 19175 heartbeater.cc:499] Master 127.16.219.254:37813 was elected leader, sending a full tablet report...
I20260808 13:47:55.441872 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.194:37283
I20260808 13:47:55.442399 19256 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.194:37283 every 8 connection(s)
I20260808 13:47:55.467886 19258 heartbeater.cc:344] Connected to a master server at 127.16.219.252:36493
I20260808 13:47:55.468405 19258 heartbeater.cc:461] Registering TS with master...
I20260808 13:47:55.469391 19258 heartbeater.cc:507] Master 127.16.219.252:36493 requested a full tablet report, sending...
I20260808 13:47:55.469667 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260808 13:47:55.472265 18986 ts_manager.cc:194] Registered new tserver with Master: d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
E20260808 13:47:55.472452 17263 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
I20260808 13:47:55.476047 19261 heartbeater.cc:344] Connected to a master server at 127.16.219.254:37813
I20260808 13:47:55.476533 19261 heartbeater.cc:461] Registering TS with master...
I20260808 13:47:55.477715 19261 heartbeater.cc:507] Master 127.16.219.254:37813 requested a full tablet report, sending...
W20260808 13:47:55.479351 19265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:55.480962 18841 ts_manager.cc:194] Registered new tserver with Master: d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
W20260808 13:47:55.481773 19266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:55.482956 18841 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37240
I20260808 13:47:55.484236 19259 heartbeater.cc:344] Connected to a master server at 127.16.219.253:44897
I20260808 13:47:55.486166 19259 heartbeater.cc:461] Registering TS with master...
I20260808 13:47:55.487244 17263 server_base.cc:1061] running on GCE node
W20260808 13:47:55.487317 19269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:55.487679 19259 heartbeater.cc:507] Master 127.16.219.253:44897 requested a full tablet report, sending...
I20260808 13:47:55.488565 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:47:55.488858 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:47:55.489053 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196875489037 us; error 0 us; skew 500 ppm
I20260808 13:47:55.489630 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:47:55.490592 18914 ts_manager.cc:194] Registered new tserver with Master: d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:47:55.492318 17263 webserver.cc:533] Webserver started at http://127.16.219.195:43835/ using document root <none> and password file <none>
I20260808 13:47:55.492825 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:47:55.493032 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:47:55.493294 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:47:55.494442 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/ts-2-root/instance:
uuid: "bad61df9bf4649639959aea33b6d7ccd"
format_stamp: "Formatted at 2026-08-08 13:47:55 on dist-test-slave-mn4r"
I20260808 13:47:55.499258 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 13:47:55.502593 19275 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:55.503334 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20260808 13:47:55.503631 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/ts-2-root
uuid: "bad61df9bf4649639959aea33b6d7ccd"
format_stamp: "Formatted at 2026-08-08 13:47:55 on dist-test-slave-mn4r"
I20260808 13:47:55.503925 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:47:55.520479 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:47:55.521697 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:47:55.522910 17263 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 13:47:55.525041 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 13:47:55.525287 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:55.525533 17263 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 13:47:55.525722 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:55.587841 19261 heartbeater.cc:499] Master 127.16.219.254:37813 was elected leader, sending a full tablet report...
I20260808 13:47:55.607160 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.195:44613
I20260808 13:47:55.607259 19345 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.195:44613 every 8 connection(s)
I20260808 13:47:55.629505 19347 heartbeater.cc:344] Connected to a master server at 127.16.219.252:36493
I20260808 13:47:55.629998 19347 heartbeater.cc:461] Registering TS with master...
I20260808 13:47:55.631042 19347 heartbeater.cc:507] Master 127.16.219.252:36493 requested a full tablet report, sending...
I20260808 13:47:55.634492 18986 ts_manager.cc:194] Registered new tserver with Master: bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:47:55.635172 19349 heartbeater.cc:344] Connected to a master server at 127.16.219.254:37813
I20260808 13:47:55.635589 19349 heartbeater.cc:461] Registering TS with master...
I20260808 13:47:55.636543 19349 heartbeater.cc:507] Master 127.16.219.254:37813 requested a full tablet report, sending...
I20260808 13:47:55.637600 19348 heartbeater.cc:344] Connected to a master server at 127.16.219.253:44897
I20260808 13:47:55.637991 19348 heartbeater.cc:461] Registering TS with master...
I20260808 13:47:55.639133 19348 heartbeater.cc:507] Master 127.16.219.253:44897 requested a full tablet report, sending...
I20260808 13:47:55.639500 18840 ts_manager.cc:194] Registered new tserver with Master: bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:47:55.641274 18840 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37256
I20260808 13:47:55.641705 18914 ts_manager.cc:194] Registered new tserver with Master: bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:47:55.641999 17263 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.02451667s
I20260808 13:47:55.677502 18840 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37262:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
W20260808 13:47:55.679597 18840 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 13:47:55.744540 19349 heartbeater.cc:499] Master 127.16.219.254:37813 was elected leader, sending a full tablet report...
I20260808 13:47:55.753618 19307 tablet_service.cc:1511] Processing CreateTablet for tablet ebb6c443eab04445a885a5150910d735 (DEFAULT_TABLE table=test-table [id=7a465016c4034f30bbaf5f5046e20548]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260808 13:47:55.755479 19306 tablet_service.cc:1511] Processing CreateTablet for tablet f5931425868b4b63b910f7ceff47dc01 (DEFAULT_TABLE table=test-table [id=7a465016c4034f30bbaf5f5046e20548]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260808 13:47:55.756345 19305 tablet_service.cc:1511] Processing CreateTablet for tablet 9ee2d1274d4841acb80fab840190d1f6 (DEFAULT_TABLE table=test-table [id=7a465016c4034f30bbaf5f5046e20548]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260808 13:47:55.757445 19307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebb6c443eab04445a885a5150910d735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:47:55.759150 19306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5931425868b4b63b910f7ceff47dc01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:47:55.760068 19305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ee2d1274d4841acb80fab840190d1f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:47:55.764600 19132 tablet_service.cc:1511] Processing CreateTablet for tablet ebb6c443eab04445a885a5150910d735 (DEFAULT_TABLE table=test-table [id=7a465016c4034f30bbaf5f5046e20548]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260808 13:47:55.766270 19132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebb6c443eab04445a885a5150910d735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:47:55.771394 19131 tablet_service.cc:1511] Processing CreateTablet for tablet f5931425868b4b63b910f7ceff47dc01 (DEFAULT_TABLE table=test-table [id=7a465016c4034f30bbaf5f5046e20548]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260808 13:47:55.772931 19131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5931425868b4b63b910f7ceff47dc01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:47:55.777722 19130 tablet_service.cc:1511] Processing CreateTablet for tablet 9ee2d1274d4841acb80fab840190d1f6 (DEFAULT_TABLE table=test-table [id=7a465016c4034f30bbaf5f5046e20548]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260808 13:47:55.779816 19130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ee2d1274d4841acb80fab840190d1f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:47:55.791541 19368 tablet_bootstrap.cc:492] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd: Bootstrap starting.
I20260808 13:47:55.793756 19220 tablet_service.cc:1511] Processing CreateTablet for tablet ebb6c443eab04445a885a5150910d735 (DEFAULT_TABLE table=test-table [id=7a465016c4034f30bbaf5f5046e20548]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260808 13:47:55.795324 19220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebb6c443eab04445a885a5150910d735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:47:55.795472 19218 tablet_service.cc:1511] Processing CreateTablet for tablet 9ee2d1274d4841acb80fab840190d1f6 (DEFAULT_TABLE table=test-table [id=7a465016c4034f30bbaf5f5046e20548]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260808 13:47:55.796499 19369 tablet_bootstrap.cc:492] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a: Bootstrap starting.
I20260808 13:47:55.797149 19218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ee2d1274d4841acb80fab840190d1f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:47:55.802850 19219 tablet_service.cc:1511] Processing CreateTablet for tablet f5931425868b4b63b910f7ceff47dc01 (DEFAULT_TABLE table=test-table [id=7a465016c4034f30bbaf5f5046e20548]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260808 13:47:55.803797 19368 tablet_bootstrap.cc:654] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd: Neither blocks nor log segments found. Creating new log.
I20260808 13:47:55.805217 19219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5931425868b4b63b910f7ceff47dc01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:47:55.813580 19369 tablet_bootstrap.cc:654] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a: Neither blocks nor log segments found. Creating new log.
I20260808 13:47:55.828248 19368 tablet_bootstrap.cc:492] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd: No bootstrap required, opened a new log
I20260808 13:47:55.828742 19368 ts_tablet_manager.cc:1403] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.018s
I20260808 13:47:55.832155 19369 tablet_bootstrap.cc:492] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a: No bootstrap required, opened a new log
I20260808 13:47:55.832791 19369 ts_tablet_manager.cc:1403] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a: Time spent bootstrapping tablet: real 0.037s user 0.008s sys 0.007s
I20260808 13:47:55.835549 19368 raft_consensus.cc:359] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:47:55.836402 19368 raft_consensus.cc:385] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:47:55.836784 19368 raft_consensus.cc:740] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bad61df9bf4649639959aea33b6d7ccd, State: Initialized, Role: FOLLOWER
I20260808 13:47:55.837793 19368 consensus_queue.cc:260] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:47:55.838835 19373 tablet_bootstrap.cc:492] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad: Bootstrap starting.
I20260808 13:47:55.839643 19369 raft_consensus.cc:359] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:55.843297 19369 raft_consensus.cc:385] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:47:55.845100 19369 raft_consensus.cc:740] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de942a19327e426b994b416686c1412a, State: Initialized, Role: FOLLOWER
I20260808 13:47:55.848906 19368 ts_tablet_manager.cc:1434] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd: Time spent starting tablet: real 0.020s user 0.009s sys 0.007s
I20260808 13:47:55.857548 19368 tablet_bootstrap.cc:492] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd: Bootstrap starting.
I20260808 13:47:55.850509 19374 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 13:47:55.862411 19374 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:47:55.863235 19368 tablet_bootstrap.cc:654] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd: Neither blocks nor log segments found. Creating new log.
I20260808 13:47:55.868283 19374 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:47:55.855901 19369 consensus_queue.cc:260] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:55.882135 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
W20260808 13:47:55.887667 19278 leader_election.cc:343] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de942a19327e426b994b416686c1412a (127.16.219.193:40615): Illegal state: must be running to vote when last-logged opid is not known
I20260808 13:47:55.894593 19373 tablet_bootstrap.cc:654] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad: Neither blocks nor log segments found. Creating new log.
I20260808 13:47:55.897933 19231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:47:55.899178 19369 ts_tablet_manager.cc:1434] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a: Time spent starting tablet: real 0.066s user 0.009s sys 0.019s
W20260808 13:47:55.900377 19278 leader_election.cc:343] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283): Illegal state: must be running to vote when last-logged opid is not known
I20260808 13:47:55.902163 19368 tablet_bootstrap.cc:492] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd: No bootstrap required, opened a new log
I20260808 13:47:55.907655 19368 ts_tablet_manager.cc:1403] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd: Time spent bootstrapping tablet: real 0.050s user 0.019s sys 0.016s
I20260808 13:47:55.911306 19368 raft_consensus.cc:359] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:55.912101 19368 raft_consensus.cc:385] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:47:55.912456 19368 raft_consensus.cc:740] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bad61df9bf4649639959aea33b6d7ccd, State: Initialized, Role: FOLLOWER
I20260808 13:47:55.903579 19278 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd; no voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a
I20260808 13:47:55.915704 19377 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 13:47:55.916654 19374 raft_consensus.cc:2749] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 13:47:55.913251 19368 consensus_queue.cc:260] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:55.919816 19369 tablet_bootstrap.cc:492] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a: Bootstrap starting.
I20260808 13:47:55.916697 19377 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:55.943708 19368 ts_tablet_manager.cc:1434] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd: Time spent starting tablet: real 0.036s user 0.008s sys 0.000s
I20260808 13:47:55.944031 19377 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:47:55.949312 19374 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 13:47:55.949987 19374 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:55.951350 19368 tablet_bootstrap.cc:492] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd: Bootstrap starting.
I20260808 13:47:55.952553 19374 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:47:55.955578 19231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
W20260808 13:47:55.960044 19278 leader_election.cc:343] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283): Illegal state: must be running to vote when last-logged opid is not known
I20260808 13:47:55.970055 19369 tablet_bootstrap.cc:654] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a: Neither blocks nor log segments found. Creating new log.
I20260808 13:47:55.974291 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
W20260808 13:47:55.975831 19278 leader_election.cc:343] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de942a19327e426b994b416686c1412a (127.16.219.193:40615): Illegal state: must be running to vote when last-logged opid is not known
I20260808 13:47:55.976331 19278 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd; no voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a
I20260808 13:47:55.977203 19374 raft_consensus.cc:2749] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 13:47:55.982429 19231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
W20260808 13:47:55.983879 19103 leader_election.cc:343] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283): Illegal state: must be running to vote when last-logged opid is not known
I20260808 13:47:55.985313 19318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
W20260808 13:47:55.986435 19103 leader_election.cc:343] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613): Illegal state: must be running to vote when last-logged opid is not known
I20260808 13:47:55.986773 19103 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de942a19327e426b994b416686c1412a; no voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:47:55.987433 19377 raft_consensus.cc:2749] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 13:47:55.990410 19368 tablet_bootstrap.cc:654] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd: Neither blocks nor log segments found. Creating new log.
I20260808 13:47:55.992053 19373 tablet_bootstrap.cc:492] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad: No bootstrap required, opened a new log
I20260808 13:47:55.992527 19373 ts_tablet_manager.cc:1403] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad: Time spent bootstrapping tablet: real 0.154s user 0.018s sys 0.019s
I20260808 13:47:55.994521 19369 tablet_bootstrap.cc:492] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a: No bootstrap required, opened a new log
I20260808 13:47:55.995021 19369 ts_tablet_manager.cc:1403] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a: Time spent bootstrapping tablet: real 0.077s user 0.008s sys 0.006s
I20260808 13:47:55.995265 19368 tablet_bootstrap.cc:492] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd: No bootstrap required, opened a new log
I20260808 13:47:55.995702 19368 ts_tablet_manager.cc:1403] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd: Time spent bootstrapping tablet: real 0.045s user 0.010s sys 0.002s
I20260808 13:47:55.996618 19373 raft_consensus.cc:359] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:47:55.997421 19373 raft_consensus.cc:385] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:47:55.997784 19373 raft_consensus.cc:740] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d00890937b5046758a2fb3cd9c79e8ad, State: Initialized, Role: FOLLOWER
I20260808 13:47:55.998131 19369 raft_consensus.cc:359] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:47:55.998418 19368 raft_consensus.cc:359] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:55.999168 19368 raft_consensus.cc:385] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:47:55.998742 19373 consensus_queue.cc:260] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:47:55.999495 19368 raft_consensus.cc:740] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bad61df9bf4649639959aea33b6d7ccd, State: Initialized, Role: FOLLOWER
I20260808 13:47:56.000300 19368 consensus_queue.cc:260] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:55.999037 19369 raft_consensus.cc:385] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:47:56.002343 19369 raft_consensus.cc:740] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de942a19327e426b994b416686c1412a, State: Initialized, Role: FOLLOWER
I20260808 13:47:56.003064 19368 ts_tablet_manager.cc:1434] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260808 13:47:56.003445 19369 consensus_queue.cc:260] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:47:56.010389 19374 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 13:47:56.010872 19374 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:56.012880 19374 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:47:56.014158 19231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:47:56.014794 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
W20260808 13:47:56.015597 19278 leader_election.cc:343] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283): Illegal state: must be running to vote when last-logged opid is not known
I20260808 13:47:56.015543 19145 raft_consensus.cc:2468] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bad61df9bf4649639959aea33b6d7ccd in term 0.
I20260808 13:47:56.017649 19278 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a; no voters: d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:47:56.021234 19385 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 13:47:56.021788 19385 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:47:56.024302 19374 raft_consensus.cc:2804] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 13:47:56.024644 19385 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613), de942a19327e426b994b416686c1412a (127.16.219.193:40615)
I20260808 13:47:56.024842 19374 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 13:47:56.025640 19374 raft_consensus.cc:3060] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:47:56.035218 19374 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:56.036813 19373 ts_tablet_manager.cc:1434] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad: Time spent starting tablet: real 0.044s user 0.003s sys 0.029s
I20260808 13:47:56.038730 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a"
I20260808 13:47:56.039358 19145 raft_consensus.cc:3060] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:47:56.041244 19373 tablet_bootstrap.cc:492] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad: Bootstrap starting.
I20260808 13:47:56.042965 19374 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 1 election: Requested vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:47:56.043531 19231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad"
I20260808 13:47:56.044562 19377 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 13:47:56.045117 19377 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
W20260808 13:47:56.046970 19278 leader_election.cc:343] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283): Illegal state: must be running to vote when last-logged opid is not known
I20260808 13:47:56.049226 19373 tablet_bootstrap.cc:654] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad: Neither blocks nor log segments found. Creating new log.
I20260808 13:47:56.052976 19377 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:47:56.054879 19318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:47:56.055508 19318 raft_consensus.cc:2468] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de942a19327e426b994b416686c1412a in term 0.
I20260808 13:47:56.057224 19103 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a; no voters:
I20260808 13:47:56.055518 19231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:47:56.058044 19377 raft_consensus.cc:2804] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 13:47:56.058593 19231 raft_consensus.cc:2468] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de942a19327e426b994b416686c1412a in term 0.
I20260808 13:47:56.058625 19377 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 13:47:56.062557 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:47:56.059409 19377 raft_consensus.cc:3060] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:47:56.064297 19318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:47:56.064914 19318 raft_consensus.cc:2468] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 0.
I20260808 13:47:56.065551 19369 ts_tablet_manager.cc:1434] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a: Time spent starting tablet: real 0.070s user 0.008s sys 0.001s
I20260808 13:47:56.066002 19190 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad; no voters:
I20260808 13:47:56.067139 19384 raft_consensus.cc:2804] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 13:47:56.067466 19384 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 13:47:56.067715 19384 raft_consensus.cc:3060] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:47:56.070413 19369 tablet_bootstrap.cc:492] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a: Bootstrap starting.
I20260808 13:47:56.070900 19145 raft_consensus.cc:2468] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bad61df9bf4649639959aea33b6d7ccd in term 1.
I20260808 13:47:56.074476 19278 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a; no voters: d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:47:56.075709 19374 raft_consensus.cc:2804] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 13:47:56.076252 19374 raft_consensus.cc:697] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 1 LEADER]: Becoming Leader. State: Replica: bad61df9bf4649639959aea33b6d7ccd, State: Running, Role: LEADER
I20260808 13:47:56.077186 19374 consensus_queue.cc:237] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:56.080228 19369 tablet_bootstrap.cc:654] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a: Neither blocks nor log segments found. Creating new log.
I20260808 13:47:56.080865 19384 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:47:56.083529 19373 tablet_bootstrap.cc:492] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad: No bootstrap required, opened a new log
I20260808 13:47:56.084146 19373 ts_tablet_manager.cc:1403] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad: Time spent bootstrapping tablet: real 0.043s user 0.023s sys 0.016s
I20260808 13:47:56.085686 19377 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:47:56.087095 19318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd"
I20260808 13:47:56.087572 19144 raft_consensus.cc:2393] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d00890937b5046758a2fb3cd9c79e8ad in current term 1: Already voted for candidate de942a19327e426b994b416686c1412a in this term.
I20260808 13:47:56.087699 19318 raft_consensus.cc:3060] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:47:56.088400 19384 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 1 election: Requested vote from peers bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613), de942a19327e426b994b416686c1412a (127.16.219.193:40615)
I20260808 13:47:56.094748 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a"
I20260808 13:47:56.098129 19318 raft_consensus.cc:2468] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 1.
I20260808 13:47:56.099436 19190 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad; no voters: de942a19327e426b994b416686c1412a
I20260808 13:47:56.087699 19373 raft_consensus.cc:359] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:56.100225 19373 raft_consensus.cc:385] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:47:56.100548 19373 raft_consensus.cc:740] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d00890937b5046758a2fb3cd9c79e8ad, State: Initialized, Role: FOLLOWER
I20260808 13:47:56.100841 19384 raft_consensus.cc:2804] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 1 FOLLOWER]: Leader election won for term 1
I20260808 13:47:56.101351 19384 raft_consensus.cc:697] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 1 LEADER]: Becoming Leader. State: Replica: d00890937b5046758a2fb3cd9c79e8ad, State: Running, Role: LEADER
I20260808 13:47:56.101301 19373 consensus_queue.cc:260] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:56.102346 19384 consensus_queue.cc:237] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:47:56.103704 19373 ts_tablet_manager.cc:1434] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad: Time spent starting tablet: real 0.019s user 0.006s sys 0.000s
I20260808 13:47:56.104863 19373 tablet_bootstrap.cc:492] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad: Bootstrap starting.
I20260808 13:47:56.111959 19373 tablet_bootstrap.cc:654] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad: Neither blocks nor log segments found. Creating new log.
I20260808 13:47:56.112740 19073 catalog_manager.cc:1295] Loaded cluster ID: 89ddcd6e6f434b32a06787e9c40e4160
I20260808 13:47:56.113154 19073 catalog_manager.cc:1588] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e: loading cluster ID for follower catalog manager: success
I20260808 13:47:56.114708 19377 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 1 election: Requested vote from peers bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:47:56.115639 19318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd"
I20260808 13:47:56.115978 19231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad"
I20260808 13:47:56.116458 19318 raft_consensus.cc:2393] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate de942a19327e426b994b416686c1412a in current term 1: Already voted for candidate d00890937b5046758a2fb3cd9c79e8ad in this term.
I20260808 13:47:56.117918 19103 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de942a19327e426b994b416686c1412a; no voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:47:56.119243 19377 raft_consensus.cc:2749] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260808 13:47:56.123277 19073 catalog_manager.cc:1610] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e: acquiring CA information for follower catalog manager: success
I20260808 13:47:56.128577 18840 catalog_manager.cc:5697] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad reported cstate change: term changed from 0 to 1, leader changed from <none> to d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194). New cstate: current_term: 1 leader_uuid: "d00890937b5046758a2fb3cd9c79e8ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } health_report { overall_health: HEALTHY } } }
I20260808 13:47:56.131552 19081 catalog_manager.cc:1295] Loaded cluster ID: 89ddcd6e6f434b32a06787e9c40e4160
I20260808 13:47:56.133950 19369 tablet_bootstrap.cc:492] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a: No bootstrap required, opened a new log
I20260808 13:47:56.134699 19369 ts_tablet_manager.cc:1403] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a: Time spent bootstrapping tablet: real 0.064s user 0.031s sys 0.008s
I20260808 13:47:56.135185 19081 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60: loading cluster ID for follower catalog manager: success
I20260808 13:47:56.137866 19369 raft_consensus.cc:359] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:56.138845 19369 raft_consensus.cc:385] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:47:56.139142 19369 raft_consensus.cc:740] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de942a19327e426b994b416686c1412a, State: Initialized, Role: FOLLOWER
I20260808 13:47:56.139955 19369 consensus_queue.cc:260] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:56.142989 19369 ts_tablet_manager.cc:1434] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a: Time spent starting tablet: real 0.008s user 0.006s sys 0.002s
I20260808 13:47:56.149035 19384 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 13:47:56.149526 19384 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:56.150874 19073 catalog_manager.cc:1638] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 13:47:56.151518 19384 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:47:56.152689 19081 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60: acquiring CA information for follower catalog manager: success
I20260808 13:47:56.153820 19318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:47:56.154520 19318 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 0.
I20260808 13:47:56.158430 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:47:56.159049 19144 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 0.
I20260808 13:47:56.157678 19081 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 13:47:56.161778 19190 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad; no voters:
I20260808 13:47:56.164172 19384 raft_consensus.cc:2804] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 13:47:56.164568 19384 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 13:47:56.164892 19384 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 0 FOLLOWER]: Advancing to term 1
W20260808 13:47:56.172144 19278 consensus_peers.cc:597] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd -> Peer d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283): Couldn't send request to peer d00890937b5046758a2fb3cd9c79e8ad. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260808 13:47:56.175076 19374 consensus_queue.cc:1048] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260808 13:47:56.166046 18841 catalog_manager.cc:5697] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd reported cstate change: term changed from 0 to 1, leader changed from <none> to bad61df9bf4649639959aea33b6d7ccd (127.16.219.195). New cstate: current_term: 1 leader_uuid: "bad61df9bf4649639959aea33b6d7ccd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } health_report { overall_health: HEALTHY } } }
I20260808 13:47:56.195303 19385 consensus_queue.cc:1048] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 13:47:56.198377 19384 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:56.200578 19384 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 1 election: Requested vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:47:56.202822 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a"
I20260808 13:47:56.203687 19145 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:47:56.211431 19317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd"
I20260808 13:47:56.212031 19317 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:47:56.212492 19373 tablet_bootstrap.cc:492] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad: No bootstrap required, opened a new log
I20260808 13:47:56.213013 19373 ts_tablet_manager.cc:1403] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad: Time spent bootstrapping tablet: real 0.108s user 0.017s sys 0.027s
I20260808 13:47:56.217885 19373 raft_consensus.cc:359] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:56.218631 19373 raft_consensus.cc:385] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:47:56.218927 19373 raft_consensus.cc:740] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d00890937b5046758a2fb3cd9c79e8ad, State: Initialized, Role: FOLLOWER
I20260808 13:47:56.219808 19373 consensus_queue.cc:260] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:56.221730 19373 ts_tablet_manager.cc:1434] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260808 13:47:56.224838 19385 consensus_queue.cc:1048] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 13:47:56.243364 19317 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 1.
I20260808 13:47:56.245751 19190 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad; no voters:
I20260808 13:47:56.246887 19385 raft_consensus.cc:2804] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 1 FOLLOWER]: Leader election won for term 1
I20260808 13:47:56.247473 19385 raft_consensus.cc:697] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 1 LEADER]: Becoming Leader. State: Replica: d00890937b5046758a2fb3cd9c79e8ad, State: Running, Role: LEADER
I20260808 13:47:56.248488 19385 consensus_queue.cc:237] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:56.276050 19231 raft_consensus.cc:3060] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:47:56.301754 18840 catalog_manager.cc:5697] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad reported cstate change: term changed from 0 to 1, leader changed from <none> to d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194). New cstate: current_term: 1 leader_uuid: "d00890937b5046758a2fb3cd9c79e8ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } health_report { overall_health: UNKNOWN } } }
I20260808 13:47:56.257681 19145 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 1.
I20260808 13:47:56.365013 19385 consensus_queue.cc:1048] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260808 13:47:56.368726 19385 consensus_queue.cc:1048] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 13:47:56.386632 19145 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36924 (request call id 3) took 184 ms (client timeout 232 ms). Trace:
W20260808 13:47:56.393971 19145 rpcz_store.cc:269] 0808 13:47:56.201743 (+ 0us) service_pool.cc:167] Inserting onto call queue
0808 13:47:56.202465 (+ 722us) service_pool.cc:224] Handling call
0808 13:47:56.386535 (+184070us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260808 13:47:56.671590 19190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.219.195:44613, user_credentials={real_user=slave}} blocked reactor thread for 66775.9us
I20260808 13:47:56.746232 19231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01"
dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad"
from {username='slave'} at 127.0.0.1:38298
I20260808 13:47:56.746860 19231 raft_consensus.cc:591] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 1 LEADER]: Received request to step down
I20260808 13:47:56.747123 19231 raft_consensus.cc:3055] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 1 LEADER]: Stepping down as leader of term 1
I20260808 13:47:56.747354 19231 raft_consensus.cc:740] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d00890937b5046758a2fb3cd9c79e8ad, State: Running, Role: LEADER
I20260808 13:47:56.748001 19231 consensus_queue.cc:260] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:56.748885 19231 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 1 FOLLOWER]: Advancing to term 2
I20260808 13:47:56.920238 19432 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:47:56.920733 19432 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:56.922457 19432 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:47:56.923203 19231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:47:56.923403 19317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:47:56.923728 19231 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de942a19327e426b994b416686c1412a in term 2.
I20260808 13:47:56.925019 19374 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:47:56.924968 19103 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a; no voters:
I20260808 13:47:56.925621 19374 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:56.926415 19432 raft_consensus.cc:2804] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 13:47:56.926851 19432 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 1 FOLLOWER]: Starting leader election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:47:56.927302 19432 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 1 FOLLOWER]: Advancing to term 2
I20260808 13:47:56.927629 19374 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:47:56.928723 19231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:47:56.928870 19144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:47:56.929224 19231 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bad61df9bf4649639959aea33b6d7ccd in term 2.
I20260808 13:47:56.930483 19278 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad; no voters:
I20260808 13:47:56.931210 19374 raft_consensus.cc:2804] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 13:47:56.931632 19374 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 1 FOLLOWER]: Starting leader election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:47:56.931951 19374 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 1 FOLLOWER]: Advancing to term 2
I20260808 13:47:56.933418 19432 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:56.934490 19144 raft_consensus.cc:2393] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bad61df9bf4649639959aea33b6d7ccd in current term 2: Already voted for candidate de942a19327e426b994b416686c1412a in this term.
I20260808 13:47:56.935524 19432 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 2 election: Requested vote from peers d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:47:56.936420 19231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad"
I20260808 13:47:56.936830 19317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd"
I20260808 13:47:56.938519 19374 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:56.939540 19317 raft_consensus.cc:2393] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate de942a19327e426b994b416686c1412a in current term 2: Already voted for candidate bad61df9bf4649639959aea33b6d7ccd in this term.
I20260808 13:47:56.942335 19374 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 2 election: Requested vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:47:56.942479 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a"
I20260808 13:47:56.942668 19231 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de942a19327e426b994b416686c1412a in term 2.
I20260808 13:47:56.943212 19145 raft_consensus.cc:2393] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bad61df9bf4649639959aea33b6d7ccd in current term 2: Already voted for candidate de942a19327e426b994b416686c1412a in this term.
I20260808 13:47:56.944190 19231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad"
I20260808 13:47:56.944329 19103 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a; no voters: bad61df9bf4649639959aea33b6d7ccd
I20260808 13:47:56.944878 19231 raft_consensus.cc:2393] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bad61df9bf4649639959aea33b6d7ccd in current term 2: Already voted for candidate de942a19327e426b994b416686c1412a in this term.
I20260808 13:47:56.945070 19432 raft_consensus.cc:2804] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 2 FOLLOWER]: Leader election won for term 2
I20260808 13:47:56.945787 19278 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd; no voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a
I20260808 13:47:56.946537 19432 raft_consensus.cc:697] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 2 LEADER]: Becoming Leader. State: Replica: de942a19327e426b994b416686c1412a, State: Running, Role: LEADER
I20260808 13:47:56.946724 19374 raft_consensus.cc:2749] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260808 13:47:56.947479 19432 consensus_queue.cc:237] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:56.959115 18839 catalog_manager.cc:5697] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a reported cstate change: term changed from 1 to 2, leader changed from d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194) to de942a19327e426b994b416686c1412a (127.16.219.193). New cstate: current_term: 2 leader_uuid: "de942a19327e426b994b416686c1412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } health_report { overall_health: UNKNOWN } } }
I20260808 13:47:56.963580 19231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebb6c443eab04445a885a5150910d735"
dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad"
from {username='slave'} at 127.0.0.1:38298
I20260808 13:47:56.964217 19231 raft_consensus.cc:591] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 1 LEADER]: Received request to step down
I20260808 13:47:56.964541 19231 raft_consensus.cc:3055] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 1 LEADER]: Stepping down as leader of term 1
I20260808 13:47:56.964798 19231 raft_consensus.cc:740] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d00890937b5046758a2fb3cd9c79e8ad, State: Running, Role: LEADER
I20260808 13:47:56.965499 19231 consensus_queue.cc:260] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:47:56.967756 19231 raft_consensus.cc:3060] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 1 FOLLOWER]: Advancing to term 2
I20260808 13:47:57.029815 19231 raft_consensus.cc:1275] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 2 FOLLOWER]: Refusing update from remote peer de942a19327e426b994b416686c1412a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260808 13:47:57.031062 19432 consensus_queue.cc:1048] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260808 13:47:57.039907 19317 raft_consensus.cc:1275] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 2 FOLLOWER]: Refusing update from remote peer de942a19327e426b994b416686c1412a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260808 13:47:57.041368 19432 consensus_queue.cc:1048] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260808 13:47:57.081018 19375 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:47:57.081540 19375 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:47:57.083417 19375 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:47:57.084215 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:47:57.084514 19231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:47:57.085155 19231 raft_consensus.cc:2468] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bad61df9bf4649639959aea33b6d7ccd in term 2.
I20260808 13:47:57.086193 19278 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad; no voters: de942a19327e426b994b416686c1412a
I20260808 13:47:57.086828 19375 raft_consensus.cc:2804] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 13:47:57.087100 19375 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 1 FOLLOWER]: Starting leader election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:47:57.087330 19375 raft_consensus.cc:3060] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 1 FOLLOWER]: Advancing to term 2
I20260808 13:47:57.091953 19375 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:47:57.093451 19375 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 2 election: Requested vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:47:57.094323 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a"
I20260808 13:47:57.094632 19231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad"
I20260808 13:47:57.100630 19231 raft_consensus.cc:2468] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bad61df9bf4649639959aea33b6d7ccd in term 2.
I20260808 13:47:57.101770 19278 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad; no voters: de942a19327e426b994b416686c1412a
I20260808 13:47:57.102604 19375 raft_consensus.cc:2804] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 2 FOLLOWER]: Leader election won for term 2
I20260808 13:47:57.103160 19375 raft_consensus.cc:697] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 2 LEADER]: Becoming Leader. State: Replica: bad61df9bf4649639959aea33b6d7ccd, State: Running, Role: LEADER
I20260808 13:47:57.103928 19375 consensus_queue.cc:237] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:47:57.110769 18838 catalog_manager.cc:5697] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd reported cstate change: term changed from 1 to 2, leader changed from d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194) to bad61df9bf4649639959aea33b6d7ccd (127.16.219.195). New cstate: current_term: 2 leader_uuid: "bad61df9bf4649639959aea33b6d7ccd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } health_report { overall_health: UNKNOWN } } }
I20260808 13:47:57.142405 19442 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:47:57.142849 19442 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:47:57.144387 19442 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:47:57.145254 19317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:47:57.145526 19231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:47:57.146533 19231 raft_consensus.cc:2393] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de942a19327e426b994b416686c1412a in current term 2: Already voted for candidate bad61df9bf4649639959aea33b6d7ccd in this term.
I20260808 13:47:57.150688 19103 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de942a19327e426b994b416686c1412a; no voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:47:57.151789 19434 raft_consensus.cc:3060] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 1 FOLLOWER]: Advancing to term 2
I20260808 13:47:57.157584 19434 raft_consensus.cc:2749] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 13:47:57.188405 19317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6"
dest_uuid: "bad61df9bf4649639959aea33b6d7ccd"
from {username='slave'} at 127.0.0.1:46634
I20260808 13:47:57.188915 19317 raft_consensus.cc:591] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 1 LEADER]: Received request to step down
I20260808 13:47:57.189200 19317 raft_consensus.cc:3055] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 1 LEADER]: Stepping down as leader of term 1
I20260808 13:47:57.189424 19317 raft_consensus.cc:740] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bad61df9bf4649639959aea33b6d7ccd, State: Running, Role: LEADER
I20260808 13:47:57.190052 19317 consensus_queue.cc:260] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:57.191200 19317 raft_consensus.cc:3060] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 1 FOLLOWER]: Advancing to term 2
I20260808 13:47:57.193374 19145 raft_consensus.cc:1275] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 2 FOLLOWER]: Refusing update from remote peer bad61df9bf4649639959aea33b6d7ccd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260808 13:47:57.194552 19375 consensus_queue.cc:1048] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260808 13:47:57.207703 19231 raft_consensus.cc:1275] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 2 FOLLOWER]: Refusing update from remote peer bad61df9bf4649639959aea33b6d7ccd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260808 13:47:57.209187 19375 consensus_queue.cc:1048] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260808 13:47:57.305568 19434 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bad61df9bf4649639959aea33b6d7ccd)
I20260808 13:47:57.306164 19434 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:57.307825 19434 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:47:57.308547 19231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:47:57.308944 19317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:47:57.309502 19317 raft_consensus.cc:2468] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de942a19327e426b994b416686c1412a in term 2.
I20260808 13:47:57.310557 19103 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a; no voters: d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:47:57.311791 19434 raft_consensus.cc:2804] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 13:47:57.312237 19434 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 1 FOLLOWER]: Starting leader election (detected failure of leader bad61df9bf4649639959aea33b6d7ccd)
I20260808 13:47:57.312680 19434 raft_consensus.cc:3060] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 1 FOLLOWER]: Advancing to term 2
I20260808 13:47:57.318161 19434 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:57.319936 19434 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 2 election: Requested vote from peers d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:47:57.320817 19231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad"
I20260808 13:47:57.325392 19317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd"
I20260808 13:47:57.332306 19317 raft_consensus.cc:2468] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de942a19327e426b994b416686c1412a in term 2.
I20260808 13:47:57.336042 19103 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a; no voters: d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:47:57.336750 19434 raft_consensus.cc:2804] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 2 FOLLOWER]: Leader election won for term 2
I20260808 13:47:57.337278 19434 raft_consensus.cc:697] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 2 LEADER]: Becoming Leader. State: Replica: de942a19327e426b994b416686c1412a, State: Running, Role: LEADER
I20260808 13:47:57.338157 19434 consensus_queue.cc:237] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:57.345382 18838 catalog_manager.cc:5697] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a reported cstate change: term changed from 1 to 2, leader changed from bad61df9bf4649639959aea33b6d7ccd (127.16.219.195) to de942a19327e426b994b416686c1412a (127.16.219.193). New cstate: current_term: 2 leader_uuid: "de942a19327e426b994b416686c1412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } health_report { overall_health: UNKNOWN } } }
I20260808 13:47:57.382170 19384 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bad61df9bf4649639959aea33b6d7ccd)
I20260808 13:47:57.382606 19384 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:57.384088 19384 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:47:57.384914 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:47:57.385190 19317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:47:57.385987 19317 raft_consensus.cc:2393] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d00890937b5046758a2fb3cd9c79e8ad in current term 2: Already voted for candidate de942a19327e426b994b416686c1412a in this term.
I20260808 13:47:57.386883 19190 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad; no voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a
I20260808 13:47:57.387467 19384 raft_consensus.cc:3060] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 1 FOLLOWER]: Advancing to term 2
I20260808 13:47:57.392081 19384 raft_consensus.cc:2749] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 13:47:57.397099 19317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebb6c443eab04445a885a5150910d735"
dest_uuid: "bad61df9bf4649639959aea33b6d7ccd"
from {username='slave'} at 127.0.0.1:46634
I20260808 13:47:57.397665 19317 raft_consensus.cc:591] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 2 LEADER]: Received request to step down
I20260808 13:47:57.398023 19317 raft_consensus.cc:3055] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 2 LEADER]: Stepping down as leader of term 2
I20260808 13:47:57.398346 19317 raft_consensus.cc:740] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bad61df9bf4649639959aea33b6d7ccd, State: Running, Role: LEADER
I20260808 13:47:57.399560 19317 consensus_queue.cc:260] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:47:57.400725 19317 raft_consensus.cc:3060] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 2 FOLLOWER]: Advancing to term 3
I20260808 13:47:57.430152 19231 raft_consensus.cc:1275] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 2 FOLLOWER]: Refusing update from remote peer de942a19327e426b994b416686c1412a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260808 13:47:57.431577 19434 consensus_queue.cc:1048] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260808 13:47:57.442651 19317 raft_consensus.cc:1275] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 2 FOLLOWER]: Refusing update from remote peer de942a19327e426b994b416686c1412a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260808 13:47:57.445793 19434 consensus_queue.cc:1048] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260808 13:47:57.527175 19384 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bad61df9bf4649639959aea33b6d7ccd)
I20260808 13:47:57.527678 19384 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:47:57.529703 19384 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613), de942a19327e426b994b416686c1412a (127.16.219.193:40615)
I20260808 13:47:57.530316 19318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:47:57.530732 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:47:57.530861 19318 raft_consensus.cc:2468] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 3.
I20260808 13:47:57.531937 19190 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad; no voters:
I20260808 13:47:57.532646 19384 raft_consensus.cc:2804] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260808 13:47:57.532953 19384 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 2 FOLLOWER]: Starting leader election (detected failure of leader bad61df9bf4649639959aea33b6d7ccd)
I20260808 13:47:57.533293 19384 raft_consensus.cc:3060] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 2 FOLLOWER]: Advancing to term 3
I20260808 13:47:57.537791 19384 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:47:57.539827 19384 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 3 election: Requested vote from peers bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613), de942a19327e426b994b416686c1412a (127.16.219.193:40615)
I20260808 13:47:57.540392 19318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd"
I20260808 13:47:57.540766 19145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a"
I20260808 13:47:57.546310 19318 raft_consensus.cc:2468] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 3.
I20260808 13:47:57.547386 19190 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad; no voters: de942a19327e426b994b416686c1412a
I20260808 13:47:57.548060 19384 raft_consensus.cc:2804] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 3 FOLLOWER]: Leader election won for term 3
I20260808 13:47:57.549544 19384 raft_consensus.cc:697] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 3 LEADER]: Becoming Leader. State: Replica: d00890937b5046758a2fb3cd9c79e8ad, State: Running, Role: LEADER
I20260808 13:47:57.550467 19384 consensus_queue.cc:237] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:47:57.560051 18838 catalog_manager.cc:5697] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad reported cstate change: term changed from 2 to 3, leader changed from bad61df9bf4649639959aea33b6d7ccd (127.16.219.195) to d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194). New cstate: current_term: 3 leader_uuid: "d00890937b5046758a2fb3cd9c79e8ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } health_report { overall_health: HEALTHY } } }
I20260808 13:47:57.603544 19434 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bad61df9bf4649639959aea33b6d7ccd)
I20260808 13:47:57.604199 19434 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:47:57.606395 19434 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:47:57.609637 19318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:47:57.610471 19318 raft_consensus.cc:2393] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de942a19327e426b994b416686c1412a in current term 3: Already voted for candidate d00890937b5046758a2fb3cd9c79e8ad in this term.
I20260808 13:47:57.613257 19231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:47:57.612144 18839 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46336:
table { table_id: "7a465016c4034f30bbaf5f5046e20548" table_name: "test-table" } new_table_name: "NewTableName"
I20260808 13:47:57.616493 19103 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de942a19327e426b994b416686c1412a; no voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:47:57.618721 19446 raft_consensus.cc:3060] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 2 FOLLOWER]: Advancing to term 3
I20260808 13:47:57.626308 19446 raft_consensus.cc:2749] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260808 13:47:57.637941 19145 raft_consensus.cc:1275] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 3 FOLLOWER]: Refusing update from remote peer d00890937b5046758a2fb3cd9c79e8ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260808 13:47:57.639969 19318 raft_consensus.cc:1275] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 3 FOLLOWER]: Refusing update from remote peer d00890937b5046758a2fb3cd9c79e8ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260808 13:47:57.644614 17263 master.cc:562] Master@127.16.219.254:37813 shutting down...
I20260808 13:47:57.650816 19384 consensus_queue.cc:1048] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260808 13:47:57.651779 19445 consensus_queue.cc:1048] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260808 13:47:57.679010 19449 tablet.cc:1724] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 13:47:57.723448 19452 tablet.cc:1724] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 13:47:57.733500 19454 tablet.cc:1724] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 13:47:57.748706 19456 tablet.cc:1724] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 13:47:57.786032 19452 tablet.cc:1724] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 13:47:57.797853 19460 tablet.cc:1724] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 13:47:57.808269 19449 tablet.cc:1724] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 13:47:57.806635 19452 tablet.cc:1724] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 13:47:57.815094 19457 tablet.cc:1724] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 13:47:57.841209 17263 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 1 LEADER]: Raft consensus shutting down.
I20260808 13:47:57.842334 17263 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 13:47:57.842793 17263 tablet_replica.cc:333] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7: stopping tablet replica
I20260808 13:47:57.872288 17263 master.cc:584] Master@127.16.219.254:37813 shutdown complete.
I20260808 13:47:57.950138 19463 raft_consensus.cc:493] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5e2d9219789424c809f622aff07d3f7)
I20260808 13:47:57.950860 19463 raft_consensus.cc:515] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:47:57.959285 19463 leader_election.cc:290] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5e2d9219789424c809f622aff07d3f7 (127.16.219.254:37813), 43efdd0c2d224907a532c8f81d469c60 (127.16.219.252:36493)
I20260808 13:47:57.960479 18999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8034ed4c5804b538b25282ddf38e46e" candidate_term: 2 candidate_status { last_received { term: 1 index: 14 } } ignore_live_leader: false dest_uuid: "43efdd0c2d224907a532c8f81d469c60" is_pre_election: true
W20260808 13:47:57.963181 18897 leader_election.cc:336] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b5e2d9219789424c809f622aff07d3f7 (127.16.219.254:37813): Network error: Client connection negotiation failed: client connection to 127.16.219.254:37813: connect: Connection refused (error 111)
I20260808 13:47:57.963660 18897 leader_election.cc:304] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8034ed4c5804b538b25282ddf38e46e; no voters: 43efdd0c2d224907a532c8f81d469c60, b5e2d9219789424c809f622aff07d3f7
I20260808 13:47:57.964462 19463 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 13:47:58.022794 19468 raft_consensus.cc:493] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5e2d9219789424c809f622aff07d3f7)
I20260808 13:47:58.023288 19468 raft_consensus.cc:515] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:47:58.024951 19468 leader_election.cc:290] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5e2d9219789424c809f622aff07d3f7 (127.16.219.254:37813), c8034ed4c5804b538b25282ddf38e46e (127.16.219.253:44897)
I20260808 13:47:58.026068 18925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "43efdd0c2d224907a532c8f81d469c60" candidate_term: 2 candidate_status { last_received { term: 1 index: 14 } } ignore_live_leader: false dest_uuid: "c8034ed4c5804b538b25282ddf38e46e" is_pre_election: true
I20260808 13:47:58.026782 18925 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43efdd0c2d224907a532c8f81d469c60 in term 1.
I20260808 13:47:58.027873 18971 leader_election.cc:304] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43efdd0c2d224907a532c8f81d469c60, c8034ed4c5804b538b25282ddf38e46e; no voters:
I20260808 13:47:58.029032 19468 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 13:47:58.029464 19468 raft_consensus.cc:493] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5e2d9219789424c809f622aff07d3f7)
I20260808 13:47:58.029896 19468 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 1 FOLLOWER]: Advancing to term 2
W20260808 13:47:58.031874 18969 leader_election.cc:336] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b5e2d9219789424c809f622aff07d3f7 (127.16.219.254:37813): Network error: Client connection negotiation failed: client connection to 127.16.219.254:37813: connect: Connection refused (error 111)
I20260808 13:47:58.036118 19468 raft_consensus.cc:515] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:47:58.037643 19468 leader_election.cc:290] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [CANDIDATE]: Term 2 election: Requested vote from peers b5e2d9219789424c809f622aff07d3f7 (127.16.219.254:37813), c8034ed4c5804b538b25282ddf38e46e (127.16.219.253:44897)
I20260808 13:47:58.038686 18925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "43efdd0c2d224907a532c8f81d469c60" candidate_term: 2 candidate_status { last_received { term: 1 index: 14 } } ignore_live_leader: false dest_uuid: "c8034ed4c5804b538b25282ddf38e46e"
I20260808 13:47:58.039398 18925 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 1 FOLLOWER]: Advancing to term 2
W20260808 13:47:58.043056 18969 leader_election.cc:336] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b5e2d9219789424c809f622aff07d3f7 (127.16.219.254:37813): Network error: Client connection negotiation failed: client connection to 127.16.219.254:37813: connect: Connection refused (error 111)
I20260808 13:47:58.045378 18925 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43efdd0c2d224907a532c8f81d469c60 in term 2.
I20260808 13:47:58.046422 18971 leader_election.cc:304] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43efdd0c2d224907a532c8f81d469c60, c8034ed4c5804b538b25282ddf38e46e; no voters: b5e2d9219789424c809f622aff07d3f7
I20260808 13:47:58.047116 19468 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 13:47:58.048410 19468 raft_consensus.cc:697] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 2 LEADER]: Becoming Leader. State: Replica: 43efdd0c2d224907a532c8f81d469c60, State: Running, Role: LEADER
I20260808 13:47:58.049304 19468 consensus_queue.cc:237] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 1.14, Last appended by leader: 14, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:47:58.054317 19471 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 43efdd0c2d224907a532c8f81d469c60. Latest consensus state: current_term: 2 leader_uuid: "43efdd0c2d224907a532c8f81d469c60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:58.054875 19471 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: This master's current role is: LEADER
I20260808 13:47:58.057219 19473 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 13:47:58.064116 19473 catalog_manager.cc:679] Loaded metadata for table NewTableName [id=7a465016c4034f30bbaf5f5046e20548]
I20260808 13:47:58.070411 19473 tablet_loader.cc:96] loaded metadata for tablet 9ee2d1274d4841acb80fab840190d1f6 (table NewTableName [id=7a465016c4034f30bbaf5f5046e20548])
I20260808 13:47:58.071581 19473 tablet_loader.cc:96] loaded metadata for tablet ebb6c443eab04445a885a5150910d735 (table NewTableName [id=7a465016c4034f30bbaf5f5046e20548])
I20260808 13:47:58.072577 19473 tablet_loader.cc:96] loaded metadata for tablet f5931425868b4b63b910f7ceff47dc01 (table NewTableName [id=7a465016c4034f30bbaf5f5046e20548])
I20260808 13:47:58.073553 19473 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 13:47:58.076649 19473 catalog_manager.cc:1295] Loaded cluster ID: 89ddcd6e6f434b32a06787e9c40e4160
I20260808 13:47:58.076920 19473 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 13:47:58.080324 19473 catalog_manager.cc:1540] Loading token signing keys...
I20260808 13:47:58.083294 19473 catalog_manager.cc:6081] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60: Loaded TSK: 0
I20260808 13:47:58.084290 19473 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 13:47:58.086789 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:47:58.092247 19474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:58.094237 19475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:58.096452 19477 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:58.096698 17263 server_base.cc:1061] running on GCE node
I20260808 13:47:58.098217 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:47:58.098455 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:47:58.098604 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196878098593 us; error 0 us; skew 500 ppm
I20260808 13:47:58.099078 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:47:58.101950 17263 webserver.cc:533] Webserver started at http://127.16.219.254:32993/ using document root <none> and password file <none>
I20260808 13:47:58.102495 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:47:58.102676 17263 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260808 13:47:58.106916 17263 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260808 13:47:58.109591 19482 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:58.110430 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 13:47:58.110729 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/master-0-root
uuid: "b5e2d9219789424c809f622aff07d3f7"
format_stamp: "Formatted at 2026-08-08 13:47:54 on dist-test-slave-mn4r"
I20260808 13:47:58.111040 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:47:58.122684 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:47:58.123612 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260808 13:47:58.157301 18969 consensus_peers.cc:597] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 -> Peer b5e2d9219789424c809f622aff07d3f7 (127.16.219.254:37813): Couldn't send request to peer b5e2d9219789424c809f622aff07d3f7. Status: Network error: Client connection negotiation failed: client connection to 127.16.219.254:37813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 13:47:58.169653 18925 raft_consensus.cc:1275] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 2 FOLLOWER]: Refusing update from remote peer 43efdd0c2d224907a532c8f81d469c60: Log matching property violated. Preceding OpId in replica: term: 1 index: 14. Preceding OpId from leader: term: 2 index: 15. (index mismatch)
I20260808 13:47:58.171437 19471 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260808 13:47:58.178454 19463 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 43efdd0c2d224907a532c8f81d469c60. Latest consensus state: current_term: 2 leader_uuid: "43efdd0c2d224907a532c8f81d469c60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:58.179437 19463 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: This master's current role is: FOLLOWER
I20260808 13:47:58.183045 19468 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "43efdd0c2d224907a532c8f81d469c60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:58.184056 19468 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: This master's current role is: LEADER
I20260808 13:47:58.185371 19463 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "43efdd0c2d224907a532c8f81d469c60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:58.186367 19463 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: This master's current role is: FOLLOWER
I20260808 13:47:58.188710 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.254:37813
I20260808 13:47:58.188930 19541 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.254:37813 every 8 connection(s)
I20260808 13:47:58.200059 19543 sys_catalog.cc:263] Verifying existing consensus state
I20260808 13:47:58.205014 19543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7: Bootstrap starting.
I20260808 13:47:58.257198 19543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=11 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 13:47:58.258466 19543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7: Bootstrap complete.
I20260808 13:47:58.258771 19258 heartbeater.cc:499] Master 127.16.219.252:36493 was elected leader, sending a full tablet report...
I20260808 13:47:58.261601 19347 heartbeater.cc:499] Master 127.16.219.252:36493 was elected leader, sending a full tablet report...
I20260808 13:47:58.262643 19543 raft_consensus.cc:359] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:47:58.263420 19543 raft_consensus.cc:740] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5e2d9219789424c809f622aff07d3f7, State: Initialized, Role: FOLLOWER
I20260808 13:47:58.268035 19543 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 1.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:47:58.282518 19172 heartbeater.cc:499] Master 127.16.219.252:36493 was elected leader, sending a full tablet report...
I20260808 13:47:58.279125 19548 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:58.288235 19548 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 13:47:58.289446 19543 sys_catalog.cc:565] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 13:47:58.289810 19510 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 1 FOLLOWER]: Advancing to term 2
I20260808 13:47:58.309674 19349 heartbeater.cc:344] Connected to a master server at 127.16.219.254:37813
I20260808 13:47:58.315353 19261 heartbeater.cc:344] Connected to a master server at 127.16.219.254:37813
I20260808 13:47:58.321959 19175 heartbeater.cc:344] Connected to a master server at 127.16.219.254:37813
I20260808 13:47:58.337119 18986 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60: NewTableName [id=7a465016c4034f30bbaf5f5046e20548] alter complete (version 1)
I20260808 13:47:58.352208 19548 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 43efdd0c2d224907a532c8f81d469c60. Latest consensus state: current_term: 2 leader_uuid: "43efdd0c2d224907a532c8f81d469c60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:58.353304 19548 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 13:47:58.356370 19471 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "43efdd0c2d224907a532c8f81d469c60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:58.357354 19471 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: This master's current role is: LEADER
I20260808 13:47:58.358454 19548 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "43efdd0c2d224907a532c8f81d469c60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:58.359738 19548 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 13:47:58.373206 19570 catalog_manager.cc:1295] Loaded cluster ID: 89ddcd6e6f434b32a06787e9c40e4160
I20260808 13:47:58.373540 19570 catalog_manager.cc:1588] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7: loading cluster ID for follower catalog manager: success
I20260808 13:47:58.379316 19570 catalog_manager.cc:1610] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7: acquiring CA information for follower catalog manager: success
I20260808 13:47:58.383708 19570 catalog_manager.cc:1638] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 13:47:58.429883 19499 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" instance_seqno: 1786196875584047) as {username='slave'} at 127.0.0.1:46546; Asking this server to re-register.
I20260808 13:47:58.429960 19498 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" instance_seqno: 1786196875420143) as {username='slave'} at 127.0.0.1:46536; Asking this server to re-register.
I20260808 13:47:58.431674 19261 heartbeater.cc:461] Registering TS with master...
I20260808 13:47:58.431703 19349 heartbeater.cc:461] Registering TS with master...
I20260808 13:47:58.435679 19498 ts_manager.cc:194] Registered new tserver with Master: d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:47:58.435894 19499 ts_manager.cc:194] Registered new tserver with Master: bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:47:58.437358 19497 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "de942a19327e426b994b416686c1412a" instance_seqno: 1786196875251165) as {username='slave'} at 127.0.0.1:46550; Asking this server to re-register.
I20260808 13:47:58.438824 19175 heartbeater.cc:461] Registering TS with master...
I20260808 13:47:58.441928 19497 ts_manager.cc:194] Registered new tserver with Master: de942a19327e426b994b416686c1412a (127.16.219.193:40615)
I20260808 13:47:58.442715 17263 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.250954762s
I20260808 13:47:58.455977 17263 master.cc:562] Master@127.16.219.252:36493 shutting down...
I20260808 13:47:58.539731 17263 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 2 LEADER]: Raft consensus shutting down.
I20260808 13:47:58.541329 17263 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260808 13:47:58.541975 17263 tablet_replica.cc:333] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60: stopping tablet replica
I20260808 13:47:58.627774 17263 master.cc:584] Master@127.16.219.252:36493 shutdown complete.
I20260808 13:47:58.678184 19463 raft_consensus.cc:493] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43efdd0c2d224907a532c8f81d469c60)
I20260808 13:47:58.678647 19463 raft_consensus.cc:515] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:47:58.680365 19463 leader_election.cc:290] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5e2d9219789424c809f622aff07d3f7 (127.16.219.254:37813), 43efdd0c2d224907a532c8f81d469c60 (127.16.219.252:36493)
W20260808 13:47:58.693456 18900 leader_election.cc:336] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 43efdd0c2d224907a532c8f81d469c60 (127.16.219.252:36493): Network error: Client connection negotiation failed: client connection to 127.16.219.252:36493: connect: Connection refused (error 111)
I20260808 13:47:58.694823 19510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8034ed4c5804b538b25282ddf38e46e" candidate_term: 3 candidate_status { last_received { term: 2 index: 16 } } ignore_live_leader: false dest_uuid: "b5e2d9219789424c809f622aff07d3f7" is_pre_election: true
I20260808 13:47:58.696038 18897 leader_election.cc:304] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8034ed4c5804b538b25282ddf38e46e; no voters: 43efdd0c2d224907a532c8f81d469c60, b5e2d9219789424c809f622aff07d3f7
I20260808 13:47:58.696724 19463 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260808 13:47:58.740518 19548 raft_consensus.cc:493] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 43efdd0c2d224907a532c8f81d469c60)
I20260808 13:47:58.741014 19548 raft_consensus.cc:515] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:47:58.743552 19548 leader_election.cc:290] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c8034ed4c5804b538b25282ddf38e46e (127.16.219.253:44897), 43efdd0c2d224907a532c8f81d469c60 (127.16.219.252:36493)
W20260808 13:47:58.751006 19486 leader_election.cc:336] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 43efdd0c2d224907a532c8f81d469c60 (127.16.219.252:36493): Network error: Client connection negotiation failed: client connection to 127.16.219.252:36493: connect: Connection refused (error 111)
I20260808 13:47:58.755714 18925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e2d9219789424c809f622aff07d3f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 16 } } ignore_live_leader: false dest_uuid: "c8034ed4c5804b538b25282ddf38e46e" is_pre_election: true
I20260808 13:47:58.756393 18925 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5e2d9219789424c809f622aff07d3f7 in term 2.
I20260808 13:47:58.757433 19484 leader_election.cc:304] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5e2d9219789424c809f622aff07d3f7, c8034ed4c5804b538b25282ddf38e46e; no voters: 43efdd0c2d224907a532c8f81d469c60
I20260808 13:47:58.758183 19548 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260808 13:47:58.758533 19548 raft_consensus.cc:493] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 43efdd0c2d224907a532c8f81d469c60)
I20260808 13:47:58.758770 19548 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 2 FOLLOWER]: Advancing to term 3
I20260808 13:47:58.763510 19548 raft_consensus.cc:515] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:47:58.765117 19548 leader_election.cc:290] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [CANDIDATE]: Term 3 election: Requested vote from peers c8034ed4c5804b538b25282ddf38e46e (127.16.219.253:44897), 43efdd0c2d224907a532c8f81d469c60 (127.16.219.252:36493)
I20260808 13:47:58.765779 18925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e2d9219789424c809f622aff07d3f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 16 } } ignore_live_leader: false dest_uuid: "c8034ed4c5804b538b25282ddf38e46e"
I20260808 13:47:58.766292 18925 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 2 FOLLOWER]: Advancing to term 3
W20260808 13:47:58.769260 19486 leader_election.cc:336] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 43efdd0c2d224907a532c8f81d469c60 (127.16.219.252:36493): Network error: Client connection negotiation failed: client connection to 127.16.219.252:36493: connect: Connection refused (error 111)
I20260808 13:47:58.771625 18925 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5e2d9219789424c809f622aff07d3f7 in term 3.
I20260808 13:47:58.772553 19484 leader_election.cc:304] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5e2d9219789424c809f622aff07d3f7, c8034ed4c5804b538b25282ddf38e46e; no voters: 43efdd0c2d224907a532c8f81d469c60
I20260808 13:47:58.773255 19548 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 13:47:58.773729 19548 raft_consensus.cc:697] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 3 LEADER]: Becoming Leader. State: Replica: b5e2d9219789424c809f622aff07d3f7, State: Running, Role: LEADER
I20260808 13:47:58.774525 19548 consensus_queue.cc:237] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 2.16, Last appended by leader: 16, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:47:58.777563 19559 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5e2d9219789424c809f622aff07d3f7. Latest consensus state: current_term: 3 leader_uuid: "b5e2d9219789424c809f622aff07d3f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:58.778328 19559 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: This master's current role is: LEADER
I20260808 13:47:58.780709 19580 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 13:47:58.788693 19580 catalog_manager.cc:679] Loaded metadata for table NewTableName [id=7a465016c4034f30bbaf5f5046e20548]
I20260808 13:47:58.794202 19580 tablet_loader.cc:96] loaded metadata for tablet 9ee2d1274d4841acb80fab840190d1f6 (table NewTableName [id=7a465016c4034f30bbaf5f5046e20548])
I20260808 13:47:58.795476 19580 tablet_loader.cc:96] loaded metadata for tablet ebb6c443eab04445a885a5150910d735 (table NewTableName [id=7a465016c4034f30bbaf5f5046e20548])
I20260808 13:47:58.796774 19580 tablet_loader.cc:96] loaded metadata for tablet f5931425868b4b63b910f7ceff47dc01 (table NewTableName [id=7a465016c4034f30bbaf5f5046e20548])
I20260808 13:47:58.798040 19580 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 13:47:58.800977 19580 catalog_manager.cc:1295] Loaded cluster ID: 89ddcd6e6f434b32a06787e9c40e4160
I20260808 13:47:58.801219 19580 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 13:47:58.804569 19580 catalog_manager.cc:1540] Loading token signing keys...
I20260808 13:47:58.807725 19580 catalog_manager.cc:6081] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7: Loaded TSK: 0
I20260808 13:47:58.808432 19580 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 13:47:58.844645 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:47:58.850648 19581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:58.851081 19582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:58.852540 19585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:58.854031 17263 server_base.cc:1061] running on GCE node
I20260808 13:47:58.855188 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:47:58.855460 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:47:58.855712 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196878855691 us; error 0 us; skew 500 ppm
I20260808 13:47:58.856529 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260808 13:47:58.859119 19486 consensus_peers.cc:597] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 -> Peer 43efdd0c2d224907a532c8f81d469c60 (127.16.219.252:36493): Couldn't send request to peer 43efdd0c2d224907a532c8f81d469c60. Status: Network error: Client connection negotiation failed: client connection to 127.16.219.252:36493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 13:47:58.859344 18925 raft_consensus.cc:1275] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 3 FOLLOWER]: Refusing update from remote peer b5e2d9219789424c809f622aff07d3f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 16. Preceding OpId from leader: term: 3 index: 17. (index mismatch)
I20260808 13:47:58.860210 17263 webserver.cc:533] Webserver started at http://127.16.219.252:41281/ using document root <none> and password file <none>
I20260808 13:47:58.860886 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:47:58.861258 17263 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260808 13:47:58.860893 19559 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260808 13:47:58.864722 19463 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5e2d9219789424c809f622aff07d3f7. Latest consensus state: current_term: 3 leader_uuid: "b5e2d9219789424c809f622aff07d3f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:58.865593 19463 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: This master's current role is: FOLLOWER
I20260808 13:47:58.866078 17263 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 13:47:58.870138 19463 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "b5e2d9219789424c809f622aff07d3f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:58.870888 19463 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: This master's current role is: FOLLOWER
I20260808 13:47:58.872076 19593 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:58.873170 17263 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 13:47:58.873486 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/master-2-root
uuid: "43efdd0c2d224907a532c8f81d469c60"
format_stamp: "Formatted at 2026-08-08 13:47:54 on dist-test-slave-mn4r"
I20260808 13:47:58.873775 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/master-2-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/master-2-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/master-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:47:58.880481 19548 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "b5e2d9219789424c809f622aff07d3f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:58.881377 19548 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: This master's current role is: LEADER
I20260808 13:47:58.890383 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:47:58.891798 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:47:58.936287 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.252:36493
I20260808 13:47:58.936429 19647 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.252:36493 every 8 connection(s)
I20260808 13:47:58.945248 19649 sys_catalog.cc:263] Verifying existing consensus state
I20260808 13:47:58.949705 19649 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60: Bootstrap starting.
I20260808 13:47:58.986114 19175 heartbeater.cc:499] Master 127.16.219.254:37813 was elected leader, sending a full tablet report...
I20260808 13:47:58.992609 19347 heartbeater.cc:344] Connected to a master server at 127.16.219.252:36493
I20260808 13:47:58.995373 19261 heartbeater.cc:499] Master 127.16.219.254:37813 was elected leader, sending a full tablet report...
I20260808 13:47:58.996526 19349 heartbeater.cc:499] Master 127.16.219.254:37813 was elected leader, sending a full tablet report...
I20260808 13:47:59.012814 19258 heartbeater.cc:344] Connected to a master server at 127.16.219.252:36493
I20260808 13:47:59.014520 19649 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=0 applied=16 ignored=0} inserts{seen=7 ignored=0} mutations{seen=12 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 13:47:59.015681 19649 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60: Bootstrap complete.
I20260808 13:47:59.018882 19649 raft_consensus.cc:359] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:47:59.019474 19649 raft_consensus.cc:740] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43efdd0c2d224907a532c8f81d469c60, State: Initialized, Role: FOLLOWER
I20260808 13:47:59.020298 19649 consensus_queue.cc:260] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 16, Last appended: 2.16, Last appended by leader: 16, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:47:59.022460 19655 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:59.023257 19655 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 13:47:59.024031 19649 sys_catalog.cc:565] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 13:47:59.024477 19621 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 2 FOLLOWER]: Advancing to term 3
I20260808 13:47:59.029485 19172 heartbeater.cc:344] Connected to a master server at 127.16.219.252:36493
I20260808 13:47:59.043932 19655 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5e2d9219789424c809f622aff07d3f7. Latest consensus state: current_term: 3 leader_uuid: "b5e2d9219789424c809f622aff07d3f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:59.045217 19655 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 13:47:59.043596 19665 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "b5e2d9219789424c809f622aff07d3f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:59.046452 19665 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 13:47:59.056592 19670 catalog_manager.cc:1295] Loaded cluster ID: 89ddcd6e6f434b32a06787e9c40e4160
I20260808 13:47:59.056846 19670 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60: loading cluster ID for follower catalog manager: success
I20260808 13:47:59.061985 19670 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60: acquiring CA information for follower catalog manager: success
I20260808 13:47:59.066001 19670 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 13:47:59.122187 19611 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" instance_seqno: 1786196875584047) as {username='slave'} at 127.0.0.1:43428; Asking this server to re-register.
I20260808 13:47:59.128175 19548 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "b5e2d9219789424c809f622aff07d3f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:59.129348 19548 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: This master's current role is: LEADER
I20260808 13:47:59.132149 19610 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" instance_seqno: 1786196875420143) as {username='slave'} at 127.0.0.1:43434; Asking this server to re-register.
I20260808 13:47:59.138691 19347 heartbeater.cc:461] Registering TS with master...
I20260808 13:47:59.143991 19608 ts_manager.cc:194] Registered new tserver with Master: bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:47:59.149283 19610 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "de942a19327e426b994b416686c1412a" instance_seqno: 1786196875251165) as {username='slave'} at 127.0.0.1:43430; Asking this server to re-register.
I20260808 13:47:59.151734 19258 heartbeater.cc:461] Registering TS with master...
I20260808 13:47:59.152022 19172 heartbeater.cc:461] Registering TS with master...
I20260808 13:47:59.156013 19611 ts_manager.cc:194] Registered new tserver with Master: d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:47:59.156849 19608 ts_manager.cc:194] Registered new tserver with Master: de942a19327e426b994b416686c1412a (127.16.219.193:40615)
I20260808 13:47:59.158103 17263 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.218431444s
I20260808 13:47:59.160389 17263 master.cc:562] Master@127.16.219.254:37813 shutting down...
I20260808 13:47:59.197633 17263 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 3 LEADER]: Raft consensus shutting down.
I20260808 13:47:59.198732 17263 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260808 13:47:59.199249 17263 tablet_replica.cc:333] stopping tablet replica
I20260808 13:47:59.224064 17263 master.cc:584] Master@127.16.219.254:37813 shutdown complete.
I20260808 13:47:59.336272 19665 raft_consensus.cc:493] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5e2d9219789424c809f622aff07d3f7)
I20260808 13:47:59.336822 19665 raft_consensus.cc:515] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:47:59.339134 19665 leader_election.cc:290] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b5e2d9219789424c809f622aff07d3f7 (127.16.219.254:37813), c8034ed4c5804b538b25282ddf38e46e (127.16.219.253:44897)
W20260808 13:47:59.346279 19594 leader_election.cc:336] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b5e2d9219789424c809f622aff07d3f7 (127.16.219.254:37813): Network error: Client connection negotiation failed: client connection to 127.16.219.254:37813: connect: Connection refused (error 111)
I20260808 13:47:59.354200 18925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "43efdd0c2d224907a532c8f81d469c60" candidate_term: 4 candidate_status { last_received { term: 3 index: 17 } } ignore_live_leader: false dest_uuid: "c8034ed4c5804b538b25282ddf38e46e" is_pre_election: true
I20260808 13:47:59.356129 19595 leader_election.cc:304] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43efdd0c2d224907a532c8f81d469c60; no voters: b5e2d9219789424c809f622aff07d3f7, c8034ed4c5804b538b25282ddf38e46e
I20260808 13:47:59.356930 19665 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260808 13:47:59.377991 19678 raft_consensus.cc:493] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b5e2d9219789424c809f622aff07d3f7)
I20260808 13:47:59.378536 19678 raft_consensus.cc:515] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:47:59.380671 19678 leader_election.cc:290] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b5e2d9219789424c809f622aff07d3f7 (127.16.219.254:37813), 43efdd0c2d224907a532c8f81d469c60 (127.16.219.252:36493)
W20260808 13:47:59.397737 18897 leader_election.cc:336] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b5e2d9219789424c809f622aff07d3f7 (127.16.219.254:37813): Network error: Client connection negotiation failed: client connection to 127.16.219.254:37813: connect: Connection refused (error 111)
I20260808 13:47:59.404147 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8034ed4c5804b538b25282ddf38e46e" candidate_term: 4 candidate_status { last_received { term: 3 index: 17 } } ignore_live_leader: false dest_uuid: "43efdd0c2d224907a532c8f81d469c60" is_pre_election: true
I20260808 13:47:59.404867 19621 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8034ed4c5804b538b25282ddf38e46e in term 3.
I20260808 13:47:59.406002 18900 leader_election.cc:304] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43efdd0c2d224907a532c8f81d469c60, c8034ed4c5804b538b25282ddf38e46e; no voters: b5e2d9219789424c809f622aff07d3f7
I20260808 13:47:59.406766 19678 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260808 13:47:59.407088 19678 raft_consensus.cc:493] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 3 FOLLOWER]: Starting leader election (detected failure of leader b5e2d9219789424c809f622aff07d3f7)
I20260808 13:47:59.407374 19678 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 3 FOLLOWER]: Advancing to term 4
I20260808 13:47:59.412940 19678 raft_consensus.cc:515] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:47:59.414515 19678 leader_election.cc:290] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [CANDIDATE]: Term 4 election: Requested vote from peers b5e2d9219789424c809f622aff07d3f7 (127.16.219.254:37813), 43efdd0c2d224907a532c8f81d469c60 (127.16.219.252:36493)
I20260808 13:47:59.415576 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8034ed4c5804b538b25282ddf38e46e" candidate_term: 4 candidate_status { last_received { term: 3 index: 17 } } ignore_live_leader: false dest_uuid: "43efdd0c2d224907a532c8f81d469c60"
I20260808 13:47:59.416088 19621 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 3 FOLLOWER]: Advancing to term 4
W20260808 13:47:59.418028 18897 leader_election.cc:336] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer b5e2d9219789424c809f622aff07d3f7 (127.16.219.254:37813): Network error: Client connection negotiation failed: client connection to 127.16.219.254:37813: connect: Connection refused (error 111)
I20260808 13:47:59.422035 19621 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8034ed4c5804b538b25282ddf38e46e in term 4.
I20260808 13:47:59.423007 18900 leader_election.cc:304] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43efdd0c2d224907a532c8f81d469c60, c8034ed4c5804b538b25282ddf38e46e; no voters: b5e2d9219789424c809f622aff07d3f7
I20260808 13:47:59.423606 19678 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 4 FOLLOWER]: Leader election won for term 4
I20260808 13:47:59.424628 19678 raft_consensus.cc:697] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 4 LEADER]: Becoming Leader. State: Replica: c8034ed4c5804b538b25282ddf38e46e, State: Running, Role: LEADER
I20260808 13:47:59.425458 19678 consensus_queue.cc:237] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 3.17, Last appended by leader: 17, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:47:59.428781 19682 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8034ed4c5804b538b25282ddf38e46e. Latest consensus state: current_term: 4 leader_uuid: "c8034ed4c5804b538b25282ddf38e46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:59.429596 19682 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: This master's current role is: LEADER
I20260808 13:47:59.431352 19684 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 13:47:59.436362 19684 catalog_manager.cc:679] Loaded metadata for table NewTableName [id=7a465016c4034f30bbaf5f5046e20548]
I20260808 13:47:59.440505 19684 tablet_loader.cc:96] loaded metadata for tablet 9ee2d1274d4841acb80fab840190d1f6 (table NewTableName [id=7a465016c4034f30bbaf5f5046e20548])
I20260808 13:47:59.441540 19684 tablet_loader.cc:96] loaded metadata for tablet ebb6c443eab04445a885a5150910d735 (table NewTableName [id=7a465016c4034f30bbaf5f5046e20548])
I20260808 13:47:59.442692 19684 tablet_loader.cc:96] loaded metadata for tablet f5931425868b4b63b910f7ceff47dc01 (table NewTableName [id=7a465016c4034f30bbaf5f5046e20548])
I20260808 13:47:59.443982 19684 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 13:47:59.447368 19684 catalog_manager.cc:1295] Loaded cluster ID: 89ddcd6e6f434b32a06787e9c40e4160
I20260808 13:47:59.447631 19684 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 13:47:59.447763 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260808 13:47:59.452984 19684 catalog_manager.cc:1540] Loading token signing keys...
W20260808 13:47:59.455312 19685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:59.456218 19687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:59.459239 19684 catalog_manager.cc:6081] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e: Loaded TSK: 0
I20260808 13:47:59.460744 19684 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 13:47:59.461345 17263 server_base.cc:1061] running on GCE node
W20260808 13:47:59.462806 19689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:59.463933 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:47:59.464274 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:47:59.464520 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196879464502 us; error 0 us; skew 500 ppm
I20260808 13:47:59.465265 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:47:59.467861 17263 webserver.cc:533] Webserver started at http://127.16.219.254:32993/ using document root <none> and password file <none>
I20260808 13:47:59.468304 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:47:59.468470 17263 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260808 13:47:59.474664 17263 fs_manager.cc:714] Time spent opening directory manager: real 0.005s user 0.002s sys 0.003s
I20260808 13:47:59.477876 19695 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:59.478647 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 13:47:59.478957 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/master-0-root
uuid: "b5e2d9219789424c809f622aff07d3f7"
format_stamp: "Formatted at 2026-08-08 13:47:54 on dist-test-slave-mn4r"
I20260808 13:47:59.479332 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:47:59.495854 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:47:59.497356 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260808 13:47:59.520829 18897 consensus_peers.cc:597] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e -> Peer b5e2d9219789424c809f622aff07d3f7 (127.16.219.254:37813): Couldn't send request to peer b5e2d9219789424c809f622aff07d3f7. Status: Network error: Client connection negotiation failed: client connection to 127.16.219.254:37813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 13:47:59.531996 19621 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 4 FOLLOWER]: Refusing update from remote peer c8034ed4c5804b538b25282ddf38e46e: Log matching property violated. Preceding OpId in replica: term: 3 index: 17. Preceding OpId from leader: term: 4 index: 18. (index mismatch)
I20260808 13:47:59.533380 19682 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [LEADER]: Connected to new peer: Peer: permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260808 13:47:59.537212 19665 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8034ed4c5804b538b25282ddf38e46e. Latest consensus state: current_term: 4 leader_uuid: "c8034ed4c5804b538b25282ddf38e46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:59.538162 19665 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 13:47:59.555435 19678 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "c8034ed4c5804b538b25282ddf38e46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:59.556478 19678 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: This master's current role is: LEADER
I20260808 13:47:59.557210 19665 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "c8034ed4c5804b538b25282ddf38e46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:59.557893 19665 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 13:47:59.560650 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.254:37813
I20260808 13:47:59.560967 19752 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.254:37813 every 8 connection(s)
I20260808 13:47:59.570690 19754 sys_catalog.cc:263] Verifying existing consensus state
I20260808 13:47:59.581450 19754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7: Bootstrap starting.
I20260808 13:47:59.584641 19259 heartbeater.cc:499] Master 127.16.219.253:44897 was elected leader, sending a full tablet report...
I20260808 13:47:59.588687 19175 heartbeater.cc:344] Connected to a master server at 127.16.219.254:37813
I20260808 13:47:59.592757 19349 heartbeater.cc:344] Connected to a master server at 127.16.219.254:37813
I20260808 13:47:59.595134 19173 heartbeater.cc:499] Master 127.16.219.253:44897 was elected leader, sending a full tablet report...
I20260808 13:47:59.598717 19348 heartbeater.cc:499] Master 127.16.219.253:44897 was elected leader, sending a full tablet report...
I20260808 13:47:59.614468 19261 heartbeater.cc:344] Connected to a master server at 127.16.219.254:37813
I20260808 13:47:59.668654 19754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=0 applied=17 ignored=0} inserts{seen=7 ignored=0} mutations{seen=12 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 13:47:59.669647 19754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7: Bootstrap complete.
I20260808 13:47:59.673240 19754 raft_consensus.cc:359] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:47:59.674027 19754 raft_consensus.cc:740] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5e2d9219789424c809f622aff07d3f7, State: Initialized, Role: FOLLOWER
I20260808 13:47:59.674842 19754 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 17, Last appended: 3.17, Last appended by leader: 17, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:47:59.676911 19760 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:59.677719 19760 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 13:47:59.678200 19754 sys_catalog.cc:565] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 13:47:59.678537 19724 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 3 FOLLOWER]: Advancing to term 4
I20260808 13:47:59.690936 19760 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8034ed4c5804b538b25282ddf38e46e. Latest consensus state: current_term: 4 leader_uuid: "c8034ed4c5804b538b25282ddf38e46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:59.691644 19760 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 13:47:59.692483 19772 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "c8034ed4c5804b538b25282ddf38e46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:59.693615 19772 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 13:47:59.697126 19714 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "de942a19327e426b994b416686c1412a" instance_seqno: 1786196875251165) as {username='slave'} at 127.0.0.1:46712; Asking this server to re-register.
I20260808 13:47:59.698575 19175 heartbeater.cc:461] Registering TS with master...
I20260808 13:47:59.698647 19775 catalog_manager.cc:1295] Loaded cluster ID: 89ddcd6e6f434b32a06787e9c40e4160
I20260808 13:47:59.698926 19775 catalog_manager.cc:1588] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7: loading cluster ID for follower catalog manager: success
I20260808 13:47:59.701853 19714 ts_manager.cc:194] Registered new tserver with Master: de942a19327e426b994b416686c1412a (127.16.219.193:40615)
I20260808 13:47:59.707329 19775 catalog_manager.cc:1610] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7: acquiring CA information for follower catalog manager: success
I20260808 13:47:59.711093 19714 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" instance_seqno: 1786196875584047) as {username='slave'} at 127.0.0.1:46722; Asking this server to re-register.
I20260808 13:47:59.712384 19775 catalog_manager.cc:1638] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 13:47:59.713604 19349 heartbeater.cc:461] Registering TS with master...
I20260808 13:47:59.716753 19714 ts_manager.cc:194] Registered new tserver with Master: bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:47:59.720912 19714 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" instance_seqno: 1786196875420143) as {username='slave'} at 127.0.0.1:46730; Asking this server to re-register.
I20260808 13:47:59.721174 19678 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "c8034ed4c5804b538b25282ddf38e46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:47:59.723762 19678 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: This master's current role is: LEADER
I20260808 13:47:59.724143 19261 heartbeater.cc:461] Registering TS with master...
I20260808 13:47:59.727139 19714 ts_manager.cc:194] Registered new tserver with Master: d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:47:59.727662 17263 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.163447038s
I20260808 13:47:59.729434 17263 tablet_server.cc:179] TabletServer@127.16.219.193:0 shutting down...
I20260808 13:47:59.771534 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 13:47:59.772218 17263 tablet_replica.cc:333] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a: stopping tablet replica
I20260808 13:47:59.772745 17263 raft_consensus.cc:2243] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 2 LEADER]: Raft consensus shutting down.
I20260808 13:47:59.773491 17263 raft_consensus.cc:2272] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260808 13:47:59.775624 17263 tablet_replica.cc:333] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a: stopping tablet replica
I20260808 13:47:59.776181 17263 raft_consensus.cc:2243] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260808 13:47:59.776656 17263 raft_consensus.cc:2272] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260808 13:47:59.778476 17263 tablet_replica.cc:333] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a: stopping tablet replica
I20260808 13:47:59.778857 17263 raft_consensus.cc:2243] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 2 LEADER]: Raft consensus shutting down.
I20260808 13:47:59.779603 17263 raft_consensus.cc:2272] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260808 13:47:59.803153 17263 tablet_server.cc:196] TabletServer@127.16.219.193:0 shutdown complete.
W20260808 13:47:59.803948 19190 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.219.193:40615: connect: Connection refused (error 111) [suppressed 17 similar messages]
W20260808 13:47:59.808323 19190 consensus_peers.cc:597] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad -> Peer de942a19327e426b994b416686c1412a (127.16.219.193:40615): Couldn't send request to peer de942a19327e426b994b416686c1412a. Status: Network error: Client connection negotiation failed: client connection to 127.16.219.193:40615: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 13:47:59.819293 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260808 13:47:59.821060 17263 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260808 13:47:59.826675 19779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:59.827382 19780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:47:59.829715 19782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:47:59.831166 17263 server_base.cc:1061] running on GCE node
I20260808 13:47:59.833274 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:47:59.833509 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:47:59.833699 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196879833686 us; error 0 us; skew 500 ppm
I20260808 13:47:59.834343 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:47:59.837185 17263 webserver.cc:533] Webserver started at http://127.16.219.193:38543/ using document root <none> and password file <none>
I20260808 13:47:59.837731 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:47:59.837934 17263 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260808 13:47:59.844368 17263 fs_manager.cc:714] Time spent opening directory manager: real 0.005s user 0.004s sys 0.001s
I20260808 13:47:59.850184 19789 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:47:59.850939 17263 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 13:47:59.851246 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/ts-0-root
uuid: "de942a19327e426b994b416686c1412a"
format_stamp: "Formatted at 2026-08-08 13:47:55 on dist-test-slave-mn4r"
I20260808 13:47:59.851506 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:47:59.866621 19553 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader de942a19327e426b994b416686c1412a)
I20260808 13:47:59.867067 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:47:59.867179 19553 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:59.868817 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:47:59.869459 19553 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:47:59.871358 17263 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 13:47:59.871404 19317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
W20260808 13:47:59.873597 19190 leader_election.cc:336] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de942a19327e426b994b416686c1412a (127.16.219.193:40615): Network error: Client connection negotiation failed: client connection to 127.16.219.193:40615: connect: Connection refused (error 111)
I20260808 13:47:59.874054 19190 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad; no voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a
I20260808 13:47:59.874925 19553 raft_consensus.cc:2749] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260808 13:47:59.876087 19798 ts_tablet_manager.cc:548] Loading tablet metadata (0/3 complete)
I20260808 13:47:59.890456 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (3 total tablets, 3 live tablets)
I20260808 13:47:59.890767 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.016s user 0.002s sys 0.000s
I20260808 13:47:59.891057 17263 ts_tablet_manager.cc:600] Registering tablets (0/3 complete)
I20260808 13:47:59.895259 19798 tablet_bootstrap.cc:492] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a: Bootstrap starting.
I20260808 13:47:59.902058 17263 ts_tablet_manager.cc:616] Registered 3 tablets
I20260808 13:47:59.902403 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.011s user 0.012s sys 0.000s
I20260808 13:47:59.905700 19800 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader de942a19327e426b994b416686c1412a)
I20260808 13:47:59.906316 19800 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:59.908424 19800 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:47:59.910678 19230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
W20260808 13:47:59.916252 19278 leader_election.cc:336] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de942a19327e426b994b416686c1412a (127.16.219.193:40615): Network error: Client connection negotiation failed: client connection to 127.16.219.193:40615: connect: Connection refused (error 111)
I20260808 13:47:59.916842 19278 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd; no voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a
I20260808 13:47:59.918334 19800 raft_consensus.cc:2749] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260808 13:47:59.925347 19798 tablet.cc:1724] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 13:47:59.926589 19798 tablet_metadata.cc:647] Not flushing: waiting for 1 pins to be released.
I20260808 13:47:59.928073 19798 tablet_bootstrap.cc:492] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=26 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 13:47:59.928596 19777 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader de942a19327e426b994b416686c1412a)
I20260808 13:47:59.929255 19798 tablet_bootstrap.cc:492] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a: Bootstrap complete.
I20260808 13:47:59.929176 19777 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:59.931509 19777 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:47:59.942981 19317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:47:59.943670 19317 raft_consensus.cc:2468] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 2.
I20260808 13:47:59.947489 19798 ts_tablet_manager.cc:1403] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a: Time spent bootstrapping tablet: real 0.052s user 0.035s sys 0.012s
I20260808 13:47:59.950699 19798 raft_consensus.cc:359] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:59.951462 19798 raft_consensus.cc:740] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: de942a19327e426b994b416686c1412a, State: Initialized, Role: FOLLOWER
I20260808 13:47:59.952284 19190 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad; no voters:
I20260808 13:47:59.952409 19798 consensus_queue.cc:260] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:59.953192 19777 raft_consensus.cc:2804] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260808 13:47:59.953606 19777 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 2 FOLLOWER]: Starting leader election (detected failure of leader de942a19327e426b994b416686c1412a)
I20260808 13:47:59.954017 19777 raft_consensus.cc:3060] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 2 FOLLOWER]: Advancing to term 3
I20260808 13:47:59.954447 19800 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader de942a19327e426b994b416686c1412a)
I20260808 13:47:59.955132 19800 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:59.957690 19800 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
W20260808 13:47:59.960431 19190 leader_election.cc:336] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de942a19327e426b994b416686c1412a (127.16.219.193:40615): Network error: Client connection negotiation failed: client connection to 127.16.219.193:40615: connect: Connection refused (error 111)
I20260808 13:47:59.962495 19230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:47:59.962641 19777 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:59.963383 19230 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bad61df9bf4649639959aea33b6d7ccd in term 2.
I20260808 13:47:59.965672 19798 ts_tablet_manager.cc:1434] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a: Time spent starting tablet: real 0.018s user 0.005s sys 0.007s
I20260808 13:47:59.966121 19278 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad; no voters:
I20260808 13:47:59.966818 19798 tablet_bootstrap.cc:492] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a: Bootstrap starting.
W20260808 13:47:59.969420 19190 leader_election.cc:336] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer de942a19327e426b994b416686c1412a (127.16.219.193:40615): Network error: Client connection negotiation failed: client connection to 127.16.219.193:40615: connect: Connection refused (error 111)
I20260808 13:47:59.970695 19777 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 3 election: Requested vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:47:59.970640 19800 raft_consensus.cc:2804] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260808 13:47:59.971364 19278 leader_election.cc:336] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer de942a19327e426b994b416686c1412a (127.16.219.193:40615): Network error: Client connection negotiation failed: client connection to 127.16.219.193:40615: connect: Connection refused (error 111)
I20260808 13:47:59.971937 19800 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 2 FOLLOWER]: Starting leader election (detected failure of leader de942a19327e426b994b416686c1412a)
I20260808 13:47:59.972381 19800 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 2 FOLLOWER]: Advancing to term 3
I20260808 13:47:59.973868 19317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd"
I20260808 13:47:59.974675 19317 raft_consensus.cc:3060] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 2 FOLLOWER]: Advancing to term 3
I20260808 13:47:59.981271 19800 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:47:59.983693 19800 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 3 election: Requested vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:47:59.984200 19317 raft_consensus.cc:2468] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 3.
I20260808 13:47:59.987001 19230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad"
I20260808 13:47:59.987798 19230 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 2 FOLLOWER]: Advancing to term 3
I20260808 13:47:59.991338 19190 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad; no voters: de942a19327e426b994b416686c1412a
W20260808 13:47:59.994299 19278 leader_election.cc:336] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer de942a19327e426b994b416686c1412a (127.16.219.193:40615): Network error: Client connection negotiation failed: client connection to 127.16.219.193:40615: connect: Connection refused (error 111)
I20260808 13:47:59.997967 19777 raft_consensus.cc:2804] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 3 FOLLOWER]: Leader election won for term 3
I20260808 13:47:59.999070 19230 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bad61df9bf4649639959aea33b6d7ccd in term 3.
I20260808 13:48:00.000542 19777 raft_consensus.cc:697] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 3 LEADER]: Becoming Leader. State: Replica: d00890937b5046758a2fb3cd9c79e8ad, State: Running, Role: LEADER
I20260808 13:48:00.001569 19278 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad; no voters: de942a19327e426b994b416686c1412a
I20260808 13:48:00.003134 19800 raft_consensus.cc:2804] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 3 FOLLOWER]: Leader election won for term 3
I20260808 13:48:00.004549 19798 tablet.cc:1724] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 13:48:00.001566 19777 consensus_queue.cc:237] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:00.006042 19798 tablet_metadata.cc:647] Not flushing: waiting for 1 pins to be released.
I20260808 13:48:00.007349 19798 tablet_bootstrap.cc:492] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=20 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 13:48:00.008159 19798 tablet_bootstrap.cc:492] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a: Bootstrap complete.
I20260808 13:48:00.026552 19800 raft_consensus.cc:697] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 3 LEADER]: Becoming Leader. State: Replica: bad61df9bf4649639959aea33b6d7ccd, State: Running, Role: LEADER
I20260808 13:48:00.027570 19800 consensus_queue.cc:237] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:00.031839 19798 ts_tablet_manager.cc:1403] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a: Time spent bootstrapping tablet: real 0.065s user 0.018s sys 0.027s
I20260808 13:48:00.033018 18914 catalog_manager.cc:5697] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad reported cstate change: term changed from 2 to 3, leader changed from de942a19327e426b994b416686c1412a (127.16.219.193) to d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194). New cstate: current_term: 3 leader_uuid: "d00890937b5046758a2fb3cd9c79e8ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } health_report { overall_health: UNKNOWN } } }
I20260808 13:48:00.036011 19798 raft_consensus.cc:359] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:00.037271 19798 raft_consensus.cc:740] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: de942a19327e426b994b416686c1412a, State: Initialized, Role: FOLLOWER
I20260808 13:48:00.038975 19798 consensus_queue.cc:260] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:00.042479 19798 ts_tablet_manager.cc:1434] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a: Time spent starting tablet: real 0.010s user 0.007s sys 0.001s
I20260808 13:48:00.043730 19798 tablet_bootstrap.cc:492] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a: Bootstrap starting.
W20260808 13:48:00.103278 19190 consensus_peers.cc:597] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad -> Peer de942a19327e426b994b416686c1412a (127.16.219.193:40615): Couldn't send request to peer de942a19327e426b994b416686c1412a. Status: Network error: Client connection negotiation failed: client connection to 127.16.219.193:40615: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 13:48:00.137806 19317 raft_consensus.cc:1275] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 3 FOLLOWER]: Refusing update from remote peer d00890937b5046758a2fb3cd9c79e8ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260808 13:48:00.141129 19777 consensus_queue.cc:1048] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260808 13:48:00.141685 18914 catalog_manager.cc:5697] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad reported cstate change: term changed from 2 to 3, leader changed from de942a19327e426b994b416686c1412a (127.16.219.193) to bad61df9bf4649639959aea33b6d7ccd (127.16.219.195). New cstate: current_term: 3 leader_uuid: "bad61df9bf4649639959aea33b6d7ccd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } }
W20260808 13:48:00.146972 19278 consensus_peers.cc:597] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd -> Peer de942a19327e426b994b416686c1412a (127.16.219.193:40615): Couldn't send request to peer de942a19327e426b994b416686c1412a. Status: Network error: Client connection negotiation failed: client connection to 127.16.219.193:40615: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 13:48:00.158408 19814 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 13:48:00.159083 19814 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:00.164516 19814 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:00.210831 19814 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 13:48:00.211402 19814 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:00.213796 19814 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:00.257937 19798 tablet.cc:1724] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 13:48:00.258883 19798 tablet_metadata.cc:647] Not flushing: waiting for 1 pins to be released.
I20260808 13:48:00.260134 19798 tablet_bootstrap.cc:492] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=21 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 13:48:00.261173 19798 tablet_bootstrap.cc:492] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a: Bootstrap complete.
I20260808 13:48:00.279421 19230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:00.281948 19230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:00.294385 19798 ts_tablet_manager.cc:1403] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a: Time spent bootstrapping tablet: real 0.251s user 0.106s sys 0.091s
I20260808 13:48:00.297166 19798 raft_consensus.cc:359] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:00.297925 19798 raft_consensus.cc:740] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: de942a19327e426b994b416686c1412a, State: Initialized, Role: FOLLOWER
I20260808 13:48:00.298808 19798 consensus_queue.cc:260] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:00.301110 19798 ts_tablet_manager.cc:1434] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260808 13:48:00.317467 19317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:00.319303 19317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:00.321149 19791 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de942a19327e426b994b416686c1412a; no voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:48:00.322357 19814 raft_consensus.cc:2749] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260808 13:48:00.323534 19791 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de942a19327e426b994b416686c1412a; no voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:48:00.324651 19814 raft_consensus.cc:2749] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260808 13:48:00.339375 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.193:40615
I20260808 13:48:00.339485 19892 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.193:40615 every 8 connection(s)
I20260808 13:48:00.359592 19893 heartbeater.cc:344] Connected to a master server at 127.16.219.252:36493
I20260808 13:48:00.360162 19893 heartbeater.cc:461] Registering TS with master...
I20260808 13:48:00.361325 19893 heartbeater.cc:507] Master 127.16.219.252:36493 requested a full tablet report, sending...
I20260808 13:48:00.366671 19610 ts_manager.cc:194] Re-registered known tserver with Master: de942a19327e426b994b416686c1412a (127.16.219.193:40615)
I20260808 13:48:00.382879 19851 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:00.384130 19851 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:00.391777 19230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:00.394963 19851 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:00.397111 19848 raft_consensus.cc:3060] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 2 FOLLOWER]: Advancing to term 3
I20260808 13:48:00.402441 19895 heartbeater.cc:344] Connected to a master server at 127.16.219.254:37813
I20260808 13:48:00.402832 19895 heartbeater.cc:461] Registering TS with master...
I20260808 13:48:00.403760 19895 heartbeater.cc:507] Master 127.16.219.254:37813 requested a full tablet report, sending...
I20260808 13:48:00.409348 19894 heartbeater.cc:344] Connected to a master server at 127.16.219.253:44897
I20260808 13:48:00.409768 19894 heartbeater.cc:461] Registering TS with master...
I20260808 13:48:00.410792 19894 heartbeater.cc:507] Master 127.16.219.253:44897 requested a full tablet report, sending...
I20260808 13:48:00.417574 19713 ts_manager.cc:194] Re-registered known tserver with Master: de942a19327e426b994b416686c1412a (127.16.219.193:40615)
I20260808 13:48:00.419714 19848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:00.420162 18914 ts_manager.cc:194] Re-registered known tserver with Master: de942a19327e426b994b416686c1412a (127.16.219.193:40615)
I20260808 13:48:00.422154 19278 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd; no voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a
I20260808 13:48:00.425484 19851 raft_consensus.cc:2749] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260808 13:48:00.425976 18914 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39280
I20260808 13:48:00.428967 19894 heartbeater.cc:499] Master 127.16.219.253:44897 was elected leader, sending a full tablet report...
I20260808 13:48:00.431478 19848 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 2 FOLLOWER]: Advancing to term 3
I20260808 13:48:00.586978 17263 tablet_server.cc:179] TabletServer@127.16.219.194:0 shutting down...
I20260808 13:48:00.630259 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 13:48:00.631045 17263 tablet_replica.cc:333] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad: stopping tablet replica
I20260808 13:48:00.631896 17263 raft_consensus.cc:2243] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 3 LEADER]: Raft consensus shutting down.
I20260808 13:48:00.632840 17263 raft_consensus.cc:2272] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:00.635146 17263 tablet_replica.cc:333] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad: stopping tablet replica
I20260808 13:48:00.635681 17263 raft_consensus.cc:2243] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 3 FOLLOWER]: Raft consensus shutting down.
I20260808 13:48:00.636271 17263 raft_consensus.cc:2272] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:00.638741 17263 tablet_replica.cc:333] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad: stopping tablet replica
I20260808 13:48:00.639212 17263 raft_consensus.cc:2243] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 3 LEADER]: Raft consensus shutting down.
I20260808 13:48:00.639942 17263 raft_consensus.cc:2272] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 3 FOLLOWER]: Raft consensus is shut down!
W20260808 13:48:00.660151 19278 consensus_peers.cc:597] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd -> Peer d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283): Couldn't send request to peer d00890937b5046758a2fb3cd9c79e8ad. Status: Network error: Client connection negotiation failed: client connection to 127.16.219.194:37283: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 13:48:00.665663 17263 tablet_server.cc:196] TabletServer@127.16.219.194:0 shutdown complete.
I20260808 13:48:00.680903 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260808 13:48:00.682760 17263 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260808 13:48:00.687561 19906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:00.687813 19907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:00.689255 19909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:48:00.690438 17263 server_base.cc:1061] running on GCE node
I20260808 13:48:00.692931 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:48:00.693171 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:48:00.693367 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196880693350 us; error 0 us; skew 500 ppm
I20260808 13:48:00.693938 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:48:00.696321 17263 webserver.cc:533] Webserver started at http://127.16.219.194:34503/ using document root <none> and password file <none>
I20260808 13:48:00.696827 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:48:00.697064 17263 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260808 13:48:00.701869 17263 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 13:48:00.707800 19914 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:00.708921 17263 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260808 13:48:00.709270 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/ts-1-root
uuid: "d00890937b5046758a2fb3cd9c79e8ad"
format_stamp: "Formatted at 2026-08-08 13:47:55 on dist-test-slave-mn4r"
I20260808 13:48:00.709630 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:48:00.734669 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:48:00.736196 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:48:00.737656 17263 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 13:48:00.756325 19814 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:00.756798 19814 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:00.758419 19814 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:00.759243 19317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:00.763075 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (3 total tablets, 3 live tablets)
I20260808 13:48:00.763430 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.019s user 0.003s sys 0.000s
W20260808 13:48:00.763859 19791 leader_election.cc:336] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283): Network error: Client connection negotiation failed: client connection to 127.16.219.194:37283: connect: Connection refused (error 111)
I20260808 13:48:00.764271 19791 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de942a19327e426b994b416686c1412a; no voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:48:00.764905 19814 raft_consensus.cc:2749] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260808 13:48:00.767838 19921 tablet_bootstrap.cc:492] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad: Bootstrap starting.
I20260808 13:48:00.773625 17263 ts_tablet_manager.cc:616] Registered 3 tablets
I20260808 13:48:00.773864 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.010s user 0.007s sys 0.000s
I20260808 13:48:00.779043 19823 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:00.779570 19823 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:00.782099 19823 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:00.782804 19848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
W20260808 13:48:00.787577 19278 leader_election.cc:336] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283): Network error: Client connection negotiation failed: client connection to 127.16.219.194:37283: connect: Connection refused (error 111)
I20260808 13:48:00.788116 19278 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd; no voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a
I20260808 13:48:00.788892 19823 raft_consensus.cc:2749] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260808 13:48:00.797827 19921 tablet.cc:1724] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 13:48:00.798789 19921 tablet_metadata.cc:647] Not flushing: waiting for 1 pins to be released.
I20260808 13:48:00.801733 19921 tablet_bootstrap.cc:492] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=26 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 13:48:00.802861 19921 tablet_bootstrap.cc:492] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad: Bootstrap complete.
I20260808 13:48:00.805912 19814 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:00.806661 19814 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:00.809334 19814 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:00.817078 19317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:00.818473 19921 ts_tablet_manager.cc:1403] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad: Time spent bootstrapping tablet: real 0.051s user 0.039s sys 0.008s
I20260808 13:48:00.818858 19317 raft_consensus.cc:2468] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de942a19327e426b994b416686c1412a in term 3.
W20260808 13:48:00.821069 19791 leader_election.cc:336] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283): Network error: Client connection negotiation failed: client connection to 127.16.219.194:37283: connect: Connection refused (error 111)
I20260808 13:48:00.821465 19921 raft_consensus.cc:359] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:00.822276 19921 raft_consensus.cc:740] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: d00890937b5046758a2fb3cd9c79e8ad, State: Initialized, Role: FOLLOWER
I20260808 13:48:00.822391 19791 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a; no voters: d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:48:00.823527 19814 raft_consensus.cc:2804] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260808 13:48:00.823263 19921 consensus_queue.cc:260] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:00.823907 19814 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 3 FOLLOWER]: Starting leader election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:00.824307 19814 raft_consensus.cc:3060] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 3 FOLLOWER]: Advancing to term 4
I20260808 13:48:00.826012 19921 ts_tablet_manager.cc:1434] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20260808 13:48:00.828575 19851 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:00.829058 19851 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:00.830739 19851 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:00.834446 19921 tablet_bootstrap.cc:492] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad: Bootstrap starting.
I20260808 13:48:00.836118 19814 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:00.838254 19814 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 4 election: Requested vote from peers d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
W20260808 13:48:00.838131 19278 leader_election.cc:336] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283): Network error: Client connection negotiation failed: client connection to 127.16.219.194:37283: connect: Connection refused (error 111)
I20260808 13:48:00.841156 19317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd"
I20260808 13:48:00.841141 19848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:00.841912 19317 raft_consensus.cc:3060] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 3 FOLLOWER]: Advancing to term 4
I20260808 13:48:00.842015 19848 raft_consensus.cc:2468] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bad61df9bf4649639959aea33b6d7ccd in term 3.
I20260808 13:48:00.844287 19278 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a; no voters: d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:48:00.845275 19851 raft_consensus.cc:2804] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260808 13:48:00.845623 19851 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 3 FOLLOWER]: Starting leader election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:00.845994 19851 raft_consensus.cc:3060] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 3 FOLLOWER]: Advancing to term 4
I20260808 13:48:00.857878 19851 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:00.862753 19317 raft_consensus.cc:2468] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de942a19327e426b994b416686c1412a in term 4.
I20260808 13:48:00.863585 19851 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 4 election: Requested vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:00.864480 19848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a"
I20260808 13:48:00.865069 19848 raft_consensus.cc:3060] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 3 FOLLOWER]: Advancing to term 4
W20260808 13:48:00.867448 19278 leader_election.cc:336] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283): Network error: Client connection negotiation failed: client connection to 127.16.219.194:37283: connect: Connection refused (error 111)
W20260808 13:48:00.869597 19791 leader_election.cc:336] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283): Network error: Client connection negotiation failed: client connection to 127.16.219.194:37283: connect: Connection refused (error 111)
I20260808 13:48:00.870592 19791 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a; no voters: d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:48:00.871461 19814 raft_consensus.cc:2804] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 4 FOLLOWER]: Leader election won for term 4
I20260808 13:48:00.872668 19814 raft_consensus.cc:697] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 4 LEADER]: Becoming Leader. State: Replica: de942a19327e426b994b416686c1412a, State: Running, Role: LEADER
I20260808 13:48:00.873924 19848 raft_consensus.cc:2468] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bad61df9bf4649639959aea33b6d7ccd in term 4.
I20260808 13:48:00.873528 19814 consensus_queue.cc:237] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:00.875204 19278 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a; no voters: d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:48:00.876449 19851 raft_consensus.cc:2804] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 4 FOLLOWER]: Leader election won for term 4
I20260808 13:48:00.877933 19851 raft_consensus.cc:697] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 4 LEADER]: Becoming Leader. State: Replica: bad61df9bf4649639959aea33b6d7ccd, State: Running, Role: LEADER
I20260808 13:48:00.878830 19851 consensus_queue.cc:237] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:00.888329 18911 catalog_manager.cc:5697] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a reported cstate change: term changed from 3 to 4, leader changed from d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194) to de942a19327e426b994b416686c1412a (127.16.219.193). New cstate: current_term: 4 leader_uuid: "de942a19327e426b994b416686c1412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } health_report { overall_health: UNKNOWN } } }
I20260808 13:48:00.901226 19921 tablet.cc:1724] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 13:48:00.902509 19921 tablet_metadata.cc:647] Not flushing: waiting for 1 pins to be released.
I20260808 13:48:00.912106 18914 catalog_manager.cc:5697] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd reported cstate change: term changed from 3 to 4, leader changed from d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194) to bad61df9bf4649639959aea33b6d7ccd (127.16.219.195). New cstate: current_term: 4 leader_uuid: "bad61df9bf4649639959aea33b6d7ccd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } health_report { overall_health: UNKNOWN } } }
I20260808 13:48:00.918157 19921 tablet_bootstrap.cc:492] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=20 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 13:48:00.921120 19921 tablet_bootstrap.cc:492] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad: Bootstrap complete.
I20260808 13:48:00.950640 19921 ts_tablet_manager.cc:1403] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad: Time spent bootstrapping tablet: real 0.116s user 0.047s sys 0.033s
I20260808 13:48:00.954272 19921 raft_consensus.cc:359] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:00.955330 19921 raft_consensus.cc:740] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: d00890937b5046758a2fb3cd9c79e8ad, State: Initialized, Role: FOLLOWER
I20260808 13:48:00.956485 19921 consensus_queue.cc:260] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:00.959672 19921 ts_tablet_manager.cc:1434] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260808 13:48:00.960860 19921 tablet_bootstrap.cc:492] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad: Bootstrap starting.
I20260808 13:48:00.972146 19848 raft_consensus.cc:1275] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 4 FOLLOWER]: Refusing update from remote peer bad61df9bf4649639959aea33b6d7ccd: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260808 13:48:00.975327 19317 raft_consensus.cc:1275] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 4 FOLLOWER]: Refusing update from remote peer de942a19327e426b994b416686c1412a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260808 13:48:00.977530 19814 consensus_queue.cc:1048] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260808 13:48:00.987892 19851 consensus_queue.cc:1048] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260808 13:48:00.989876 19791 consensus_peers.cc:597] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a -> Peer d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283): Couldn't send request to peer d00890937b5046758a2fb3cd9c79e8ad. Status: Network error: Client connection negotiation failed: client connection to 127.16.219.194:37283: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260808 13:48:01.006829 19278 consensus_peers.cc:597] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd -> Peer d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283): Couldn't send request to peer d00890937b5046758a2fb3cd9c79e8ad. Status: Network error: Client connection negotiation failed: client connection to 127.16.219.194:37283: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 13:48:01.068778 19958 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 13:48:01.069361 19958 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:01.071985 19958 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:01.098778 19921 tablet.cc:1724] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 13:48:01.099960 19921 tablet_metadata.cc:647] Not flushing: waiting for 1 pins to be released.
I20260808 13:48:01.101707 19921 tablet_bootstrap.cc:492] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=21 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 13:48:01.103107 19921 tablet_bootstrap.cc:492] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad: Bootstrap complete.
I20260808 13:48:01.110649 19848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:01.116706 19921 ts_tablet_manager.cc:1403] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad: Time spent bootstrapping tablet: real 0.156s user 0.057s sys 0.037s
I20260808 13:48:01.119133 19921 raft_consensus.cc:359] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:01.120036 19317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:01.120343 19921 raft_consensus.cc:740] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: d00890937b5046758a2fb3cd9c79e8ad, State: Initialized, Role: FOLLOWER
I20260808 13:48:01.121557 19916 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad; no voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a
I20260808 13:48:01.121235 19921 consensus_queue.cc:260] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:01.122539 19958 raft_consensus.cc:2749] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260808 13:48:01.126573 19921 ts_tablet_manager.cc:1434] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20260808 13:48:01.127962 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.194:37283
I20260808 13:48:01.128140 20014 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.194:37283 every 8 connection(s)
I20260808 13:48:01.160281 20012 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 13:48:01.160859 20012 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:01.164357 20012 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:01.165982 19848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:01.166980 19317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:01.169889 20015 heartbeater.cc:344] Connected to a master server at 127.16.219.252:36493
I20260808 13:48:01.170540 20015 heartbeater.cc:461] Registering TS with master...
I20260808 13:48:01.170308 19916 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad; no voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a
I20260808 13:48:01.171459 20015 heartbeater.cc:507] Master 127.16.219.252:36493 requested a full tablet report, sending...
I20260808 13:48:01.171725 20012 raft_consensus.cc:2749] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260808 13:48:01.173309 20017 heartbeater.cc:344] Connected to a master server at 127.16.219.254:37813
I20260808 13:48:01.173686 20017 heartbeater.cc:461] Registering TS with master...
I20260808 13:48:01.174511 20017 heartbeater.cc:507] Master 127.16.219.254:37813 requested a full tablet report, sending...
I20260808 13:48:01.175969 19610 ts_manager.cc:194] Re-registered known tserver with Master: d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:01.178196 20016 heartbeater.cc:344] Connected to a master server at 127.16.219.253:44897
I20260808 13:48:01.178586 20016 heartbeater.cc:461] Registering TS with master...
I20260808 13:48:01.179013 19713 ts_manager.cc:194] Re-registered known tserver with Master: d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:01.179343 20016 heartbeater.cc:507] Master 127.16.219.253:44897 requested a full tablet report, sending...
I20260808 13:48:01.184439 18911 ts_manager.cc:194] Re-registered known tserver with Master: d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:01.191021 18911 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39286
I20260808 13:48:01.196115 19961 raft_consensus.cc:3060] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 3 FOLLOWER]: Advancing to term 4
I20260808 13:48:01.201205 19959 raft_consensus.cc:3060] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 3 FOLLOWER]: Advancing to term 4
I20260808 13:48:01.203740 20016 heartbeater.cc:499] Master 127.16.219.253:44897 was elected leader, sending a full tablet report...
I20260808 13:48:01.358776 17263 tablet_server.cc:179] TabletServer@127.16.219.195:0 shutting down...
W20260808 13:48:01.374428 19791 consensus_peers.cc:597] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a -> Peer bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613): Couldn't send request to peer bad61df9bf4649639959aea33b6d7ccd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260808 13:48:01.402212 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 13:48:01.402941 17263 tablet_replica.cc:333] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd: stopping tablet replica
I20260808 13:48:01.403522 17263 raft_consensus.cc:2243] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260808 13:48:01.404050 17263 raft_consensus.cc:2272] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:01.406517 17263 tablet_replica.cc:333] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd: stopping tablet replica
I20260808 13:48:01.407068 17263 raft_consensus.cc:2243] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 3 LEADER]: Raft consensus shutting down.
I20260808 13:48:01.407838 17263 raft_consensus.cc:2272] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:01.410322 17263 tablet_replica.cc:333] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd: stopping tablet replica
I20260808 13:48:01.411161 17263 raft_consensus.cc:2243] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 4 LEADER]: Raft consensus shutting down.
W20260808 13:48:01.411595 19800 consensus_queue.cc:1175] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d00890937b5046758a2fb3cd9c79e8ad" responder_term: 4 status { last_received { term: 4 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 4 index: 6 } }
I20260808 13:48:01.412560 17263 raft_consensus.cc:2272] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:01.438042 17263 tablet_server.cc:196] TabletServer@127.16.219.195:0 shutdown complete.
I20260808 13:48:01.455583 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260808 13:48:01.457412 17263 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260808 13:48:01.462261 20032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:01.462411 20033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:01.463977 20035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:48:01.466207 17263 server_base.cc:1061] running on GCE node
I20260808 13:48:01.468057 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:48:01.468324 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:48:01.468540 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196881468520 us; error 0 us; skew 500 ppm
I20260808 13:48:01.469337 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:48:01.477021 17263 webserver.cc:533] Webserver started at http://127.16.219.195:43835/ using document root <none> and password file <none>
I20260808 13:48:01.477702 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:48:01.477948 17263 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260808 13:48:01.482609 17263 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.002s sys 0.002s
I20260808 13:48:01.541034 19814 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bad61df9bf4649639959aea33b6d7ccd)
I20260808 13:48:01.541877 19814 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:01.547662 19814 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:01.558736 19961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:01.583719 20012 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bad61df9bf4649639959aea33b6d7ccd)
I20260808 13:48:01.584450 20012 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:01.587038 20012 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:01.591073 19848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
W20260808 13:48:01.606118 19791 leader_election.cc:336] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613): Network error: Client connection negotiation failed: client connection to 127.16.219.195:44613: connect: Connection refused (error 111)
I20260808 13:48:01.608709 19791 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de942a19327e426b994b416686c1412a; no voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:48:01.610671 20031 raft_consensus.cc:2749] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260808 13:48:01.610884 19964 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bad61df9bf4649639959aea33b6d7ccd)
I20260808 13:48:01.611756 19964 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:01.615283 19964 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:01.621039 19961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:01.621840 19961 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de942a19327e426b994b416686c1412a in term 3.
I20260808 13:48:01.638722 20012 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bad61df9bf4649639959aea33b6d7ccd)
W20260808 13:48:01.639415 19916 leader_election.cc:336] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613): Network error: Client connection negotiation failed: client connection to 127.16.219.195:44613: connect: Connection refused (error 111)
I20260808 13:48:01.639281 20012 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:01.639881 19916 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad; no voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a
I20260808 13:48:01.641505 20012 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613), de942a19327e426b994b416686c1412a (127.16.219.193:40615)
I20260808 13:48:01.642130 20012 raft_consensus.cc:2749] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260808 13:48:01.734810 19916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.219.195:44613, user_credentials={real_user=slave}} blocked reactor thread for 95420.2us
I20260808 13:48:01.751605 20043 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:01.752676 17263 fs_manager.cc:730] Time spent opening block manager: real 0.268s user 0.008s sys 0.000s
I20260808 13:48:01.753072 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/ts-2-root
uuid: "bad61df9bf4649639959aea33b6d7ccd"
format_stamp: "Formatted at 2026-08-08 13:47:55 on dist-test-slave-mn4r"
I20260808 13:48:01.753443 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:48:01.778290 19848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:01.779054 19848 raft_consensus.cc:2468] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 4.
I20260808 13:48:01.780632 19916 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a; no voters:
I20260808 13:48:01.781652 20042 raft_consensus.cc:2804] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260808 13:48:01.782132 20042 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 4 FOLLOWER]: Starting leader election (detected failure of leader bad61df9bf4649639959aea33b6d7ccd)
I20260808 13:48:01.782459 20042 raft_consensus.cc:3060] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 4 FOLLOWER]: Advancing to term 5
I20260808 13:48:01.790185 20042 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:01.792114 20042 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 5 election: Requested vote from peers bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613), de942a19327e426b994b416686c1412a (127.16.219.193:40615)
I20260808 13:48:01.793314 19848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a"
I20260808 13:48:01.793917 19848 raft_consensus.cc:3060] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 4 FOLLOWER]: Advancing to term 5
W20260808 13:48:01.798237 19916 leader_election.cc:336] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613): Network error: Client connection negotiation failed: client connection to 127.16.219.195:44613: connect: Connection refused (error 111)
W20260808 13:48:01.799065 19916 leader_election.cc:336] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613): Network error: Client connection negotiation failed: client connection to 127.16.219.195:44613: connect: Connection refused (error 111)
I20260808 13:48:01.801091 19848 raft_consensus.cc:2468] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 5.
I20260808 13:48:01.804620 19916 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a; no voters: bad61df9bf4649639959aea33b6d7ccd
I20260808 13:48:01.805773 20042 raft_consensus.cc:2804] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 5 FOLLOWER]: Leader election won for term 5
I20260808 13:48:01.806449 20042 raft_consensus.cc:697] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 5 LEADER]: Becoming Leader. State: Replica: d00890937b5046758a2fb3cd9c79e8ad, State: Running, Role: LEADER
I20260808 13:48:01.807565 20042 consensus_queue.cc:237] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:01.810603 20049 raft_consensus.cc:493] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c8034ed4c5804b538b25282ddf38e46e)
I20260808 13:48:01.811123 20049 raft_consensus.cc:515] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:48:01.814687 19791 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a; no voters:
I20260808 13:48:01.815904 19814 raft_consensus.cc:2804] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260808 13:48:01.816257 19814 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 3 FOLLOWER]: Starting leader election (detected failure of leader bad61df9bf4649639959aea33b6d7ccd)
I20260808 13:48:01.816578 19814 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 3 FOLLOWER]: Advancing to term 4
I20260808 13:48:01.818533 20050 raft_consensus.cc:493] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c8034ed4c5804b538b25282ddf38e46e)
I20260808 13:48:01.820127 20049 leader_election.cc:290] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c8034ed4c5804b538b25282ddf38e46e (127.16.219.253:44897), 43efdd0c2d224907a532c8f81d469c60 (127.16.219.252:36493)
I20260808 13:48:01.820247 20050 raft_consensus.cc:515] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:48:01.822412 20050 leader_election.cc:290] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b5e2d9219789424c809f622aff07d3f7 (127.16.219.254:37813), c8034ed4c5804b538b25282ddf38e46e (127.16.219.253:44897)
I20260808 13:48:01.823520 18925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "43efdd0c2d224907a532c8f81d469c60" candidate_term: 5 candidate_status { last_received { term: 4 index: 22 } } ignore_live_leader: false dest_uuid: "c8034ed4c5804b538b25282ddf38e46e" is_pre_election: true
I20260808 13:48:01.825547 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
W20260808 13:48:01.823164 19791 leader_election.cc:336] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613): Network error: Client connection negotiation failed: client connection to 127.16.219.195:44613: connect: Connection refused (error 111)
I20260808 13:48:01.827335 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:48:01.831807 20042 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader de942a19327e426b994b416686c1412a)
I20260808 13:48:01.832439 20042 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:01.834515 20042 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
W20260808 13:48:01.844462 19916 leader_election.cc:336] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613): Network error: Client connection negotiation failed: client connection to 127.16.219.195:44613: connect: Connection refused (error 111)
I20260808 13:48:01.851560 19814 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:01.857095 17263 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 13:48:01.864256 19848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:01.867122 19916 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad; no voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a
I20260808 13:48:01.867038 18913 catalog_manager.cc:5697] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad reported cstate change: term changed from 4 to 5, leader changed from bad61df9bf4649639959aea33b6d7ccd (127.16.219.195) to d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194). New cstate: current_term: 5 leader_uuid: "d00890937b5046758a2fb3cd9c79e8ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } health_report { overall_health: HEALTHY } } }
I20260808 13:48:01.868760 20042 raft_consensus.cc:2749] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260808 13:48:01.870072 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e2d9219789424c809f622aff07d3f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 22 } } ignore_live_leader: false dest_uuid: "43efdd0c2d224907a532c8f81d469c60" is_pre_election: true
I20260808 13:48:01.870967 19621 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5e2d9219789424c809f622aff07d3f7 in term 4.
I20260808 13:48:01.872695 19700 leader_election.cc:304] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43efdd0c2d224907a532c8f81d469c60, b5e2d9219789424c809f622aff07d3f7; no voters:
I20260808 13:48:01.873863 19961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad"
I20260808 13:48:01.874224 20049 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260808 13:48:01.874569 19961 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 3 FOLLOWER]: Advancing to term 4
I20260808 13:48:01.874789 20049 raft_consensus.cc:493] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c8034ed4c5804b538b25282ddf38e46e)
I20260808 13:48:01.875356 20049 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 4 FOLLOWER]: Advancing to term 5
I20260808 13:48:01.882871 20059 ts_tablet_manager.cc:548] Loading tablet metadata (0/3 complete)
I20260808 13:48:01.884431 19961 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de942a19327e426b994b416686c1412a in term 4.
I20260808 13:48:01.884764 20049 raft_consensus.cc:515] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:48:01.889205 19791 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a; no voters:
I20260808 13:48:01.890159 19723 raft_consensus.cc:1240] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 5 FOLLOWER]: Rejecting Update request from peer c8034ed4c5804b538b25282ddf38e46e for earlier term 4. Current term is 5. Ops: []
I20260808 13:48:01.890198 19964 raft_consensus.cc:2804] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 4 FOLLOWER]: Leader election won for term 4
I20260808 13:48:01.890697 20049 leader_election.cc:290] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [CANDIDATE]: Term 5 election: Requested vote from peers c8034ed4c5804b538b25282ddf38e46e (127.16.219.253:44897), 43efdd0c2d224907a532c8f81d469c60 (127.16.219.252:36493)
I20260808 13:48:01.890859 19964 raft_consensus.cc:697] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 4 LEADER]: Becoming Leader. State: Replica: de942a19327e426b994b416686c1412a, State: Running, Role: LEADER
I20260808 13:48:01.891774 19964 consensus_queue.cc:237] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:01.892133 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e2d9219789424c809f622aff07d3f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 22 } } ignore_live_leader: false dest_uuid: "43efdd0c2d224907a532c8f81d469c60"
I20260808 13:48:01.893157 19976 consensus_queue.cc:1059] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 }, Status: INVALID_TERM, Last received: 4.22, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
I20260808 13:48:01.902643 19848 raft_consensus.cc:1275] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 5 FOLLOWER]: Refusing update from remote peer d00890937b5046758a2fb3cd9c79e8ad: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260808 13:48:01.905386 19916 consensus_peers.cc:597] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad -> Peer bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613): Couldn't send request to peer bad61df9bf4649639959aea33b6d7ccd. Status: Network error: Client connection negotiation failed: client connection to 127.16.219.195:44613: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 13:48:01.905745 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (3 total tablets, 3 live tablets)
I20260808 13:48:01.908565 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.031s user 0.003s sys 0.002s
I20260808 13:48:01.908948 17263 ts_tablet_manager.cc:600] Registering tablets (0/3 complete)
W20260808 13:48:01.912400 19791 leader_election.cc:336] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613): Network error: Client connection negotiation failed: client connection to 127.16.219.195:44613: connect: Connection refused (error 111)
I20260808 13:48:01.913749 20012 consensus_queue.cc:1048] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260808 13:48:01.917773 20062 raft_consensus.cc:3055] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 4 LEADER]: Stepping down as leader of term 4
I20260808 13:48:01.918195 20062 raft_consensus.cc:740] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c8034ed4c5804b538b25282ddf38e46e, State: Running, Role: LEADER
I20260808 13:48:01.918967 20059 tablet_bootstrap.cc:492] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd: Bootstrap starting.
I20260808 13:48:01.919085 20062 consensus_queue.cc:260] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 4.23, Last appended by leader: 23, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:48:01.906800 19814 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 4 election: Requested vote from peers d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:01.935258 20062 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 4 FOLLOWER]: Advancing to term 5
I20260808 13:48:01.940541 19723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "43efdd0c2d224907a532c8f81d469c60" candidate_term: 5 candidate_status { last_received { term: 4 index: 22 } } ignore_live_leader: false dest_uuid: "b5e2d9219789424c809f622aff07d3f7" is_pre_election: true
I20260808 13:48:01.942227 19594 leader_election.cc:304] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43efdd0c2d224907a532c8f81d469c60; no voters: b5e2d9219789424c809f622aff07d3f7, c8034ed4c5804b538b25282ddf38e46e
I20260808 13:48:01.943065 20050 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260808 13:48:01.950806 17263 ts_tablet_manager.cc:616] Registered 3 tablets
I20260808 13:48:01.951146 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.042s user 0.019s sys 0.000s
I20260808 13:48:01.953047 18924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e2d9219789424c809f622aff07d3f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 22 } } ignore_live_leader: false dest_uuid: "c8034ed4c5804b538b25282ddf38e46e"
I20260808 13:48:01.953907 18925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e2d9219789424c809f622aff07d3f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 22 } } ignore_live_leader: false dest_uuid: "c8034ed4c5804b538b25282ddf38e46e" is_pre_election: true
I20260808 13:48:01.958694 18924 raft_consensus.cc:2410] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b5e2d9219789424c809f622aff07d3f7 for term 5 because replica has last-logged OpId of term: 4 index: 23, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 22.
I20260808 13:48:01.961802 19698 leader_election.cc:304] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5e2d9219789424c809f622aff07d3f7; no voters: 43efdd0c2d224907a532c8f81d469c60, c8034ed4c5804b538b25282ddf38e46e
I20260808 13:48:01.963052 20049 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260808 13:48:01.976315 20059 tablet.cc:1724] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 13:48:01.977070 20059 tablet_metadata.cc:647] Not flushing: waiting for 1 pins to be released.
I20260808 13:48:01.979434 20059 tablet_bootstrap.cc:492] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=26 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 13:48:01.980490 20059 tablet_bootstrap.cc:492] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd: Bootstrap complete.
I20260808 13:48:01.988651 20059 ts_tablet_manager.cc:1403] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd: Time spent bootstrapping tablet: real 0.070s user 0.035s sys 0.004s
I20260808 13:48:01.990990 20059 raft_consensus.cc:359] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:01.991796 20059 raft_consensus.cc:740] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: bad61df9bf4649639959aea33b6d7ccd, State: Initialized, Role: FOLLOWER
I20260808 13:48:01.992513 20059 consensus_queue.cc:260] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:01.995183 20059 ts_tablet_manager.cc:1434] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260808 13:48:01.996156 20059 tablet_bootstrap.cc:492] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd: Bootstrap starting.
I20260808 13:48:02.014415 19961 raft_consensus.cc:1275] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 4 FOLLOWER]: Refusing update from remote peer de942a19327e426b994b416686c1412a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260808 13:48:02.016453 19814 consensus_queue.cc:1048] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260808 13:48:02.023144 20059 tablet.cc:1724] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 13:48:02.024041 20059 tablet_metadata.cc:647] Not flushing: waiting for 1 pins to be released.
W20260808 13:48:02.024326 19791 consensus_peers.cc:597] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a -> Peer bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613): Couldn't send request to peer bad61df9bf4649639959aea33b6d7ccd. Status: Network error: Client connection negotiation failed: client connection to 127.16.219.195:44613: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 13:48:02.029896 20059 tablet_bootstrap.cc:492] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=20 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 13:48:02.031152 20059 tablet_bootstrap.cc:492] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd: Bootstrap complete.
W20260808 13:48:02.048336 19791 consensus_peers.cc:597] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a -> Peer bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613): Couldn't send request to peer bad61df9bf4649639959aea33b6d7ccd. Status: Network error: Client connection negotiation failed: client connection to 127.16.219.195:44613: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260808 13:48:02.062294 20059 ts_tablet_manager.cc:1403] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd: Time spent bootstrapping tablet: real 0.066s user 0.037s sys 0.028s
I20260808 13:48:02.062489 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.195:44613
I20260808 13:48:02.062682 20133 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.195:44613 every 8 connection(s)
I20260808 13:48:02.065867 20059 raft_consensus.cc:359] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 4 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:02.066833 20059 raft_consensus.cc:740] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: bad61df9bf4649639959aea33b6d7ccd, State: Initialized, Role: FOLLOWER
I20260808 13:48:02.067838 20059 consensus_queue.cc:260] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:02.072209 20059 ts_tablet_manager.cc:1434] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260808 13:48:02.073452 20059 tablet_bootstrap.cc:492] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd: Bootstrap starting.
I20260808 13:48:02.094759 20135 heartbeater.cc:344] Connected to a master server at 127.16.219.253:44897
I20260808 13:48:02.095268 20135 heartbeater.cc:461] Registering TS with master...
I20260808 13:48:02.099864 20135 heartbeater.cc:507] Master 127.16.219.253:44897 requested a full tablet report, sending...
I20260808 13:48:02.102152 20134 heartbeater.cc:344] Connected to a master server at 127.16.219.252:36493
I20260808 13:48:02.103057 20134 heartbeater.cc:461] Registering TS with master...
I20260808 13:48:02.103962 20134 heartbeater.cc:507] Master 127.16.219.252:36493 requested a full tablet report, sending...
I20260808 13:48:02.105068 18911 ts_manager.cc:194] Re-registered known tserver with Master: bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:02.108422 19610 ts_manager.cc:194] Re-registered known tserver with Master: bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:02.123522 20062 raft_consensus.cc:493] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 13:48:02.123978 20062 raft_consensus.cc:515] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:48:02.125861 20062 leader_election.cc:290] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b5e2d9219789424c809f622aff07d3f7 (127.16.219.254:37813), 43efdd0c2d224907a532c8f81d469c60 (127.16.219.252:36493)
I20260808 13:48:02.127095 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8034ed4c5804b538b25282ddf38e46e" candidate_term: 6 candidate_status { last_received { term: 4 index: 23 } } ignore_live_leader: false dest_uuid: "43efdd0c2d224907a532c8f81d469c60" is_pre_election: true
I20260808 13:48:02.127763 19621 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8034ed4c5804b538b25282ddf38e46e in term 4.
I20260808 13:48:02.128086 20136 heartbeater.cc:344] Connected to a master server at 127.16.219.254:37813
I20260808 13:48:02.128458 20136 heartbeater.cc:461] Registering TS with master...
I20260808 13:48:02.129343 20136 heartbeater.cc:507] Master 127.16.219.254:37813 requested a full tablet report, sending...
I20260808 13:48:02.129209 18900 leader_election.cc:304] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43efdd0c2d224907a532c8f81d469c60, c8034ed4c5804b538b25282ddf38e46e; no voters:
I20260808 13:48:02.130414 19723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8034ed4c5804b538b25282ddf38e46e" candidate_term: 6 candidate_status { last_received { term: 4 index: 23 } } ignore_live_leader: false dest_uuid: "b5e2d9219789424c809f622aff07d3f7" is_pre_election: true
I20260808 13:48:02.131050 19723 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8034ed4c5804b538b25282ddf38e46e in term 5.
I20260808 13:48:02.134294 20062 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260808 13:48:02.134711 20062 raft_consensus.cc:493] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 13:48:02.134567 20059 tablet.cc:1724] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260808 13:48:02.135063 20062 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 5 FOLLOWER]: Advancing to term 6
I20260808 13:48:02.135360 20059 tablet_metadata.cc:647] Not flushing: waiting for 1 pins to be released.
I20260808 13:48:02.137866 20059 tablet_bootstrap.cc:492] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=21 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 13:48:02.141476 20059 tablet_bootstrap.cc:492] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd: Bootstrap complete.
I20260808 13:48:02.145423 20062 raft_consensus.cc:515] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:48:02.150704 19723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8034ed4c5804b538b25282ddf38e46e" candidate_term: 6 candidate_status { last_received { term: 4 index: 23 } } ignore_live_leader: false dest_uuid: "b5e2d9219789424c809f622aff07d3f7"
I20260808 13:48:02.151336 19723 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 5 FOLLOWER]: Advancing to term 6
I20260808 13:48:02.151461 20095 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 13:48:02.152077 20095 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:02.159479 19723 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8034ed4c5804b538b25282ddf38e46e in term 6.
I20260808 13:48:02.163302 18897 leader_election.cc:304] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5e2d9219789424c809f622aff07d3f7, c8034ed4c5804b538b25282ddf38e46e; no voters:
I20260808 13:48:02.164690 20064 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 6 FOLLOWER]: Leader election won for term 6
I20260808 13:48:02.165236 20064 raft_consensus.cc:697] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 6 LEADER]: Becoming Leader. State: Replica: c8034ed4c5804b538b25282ddf38e46e, State: Running, Role: LEADER
I20260808 13:48:02.166661 20095 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:02.166360 20064 consensus_queue.cc:237] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 4.23, Last appended by leader: 23, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:48:02.168989 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8034ed4c5804b538b25282ddf38e46e" candidate_term: 6 candidate_status { last_received { term: 4 index: 23 } } ignore_live_leader: false dest_uuid: "43efdd0c2d224907a532c8f81d469c60"
I20260808 13:48:02.172134 19621 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 4 FOLLOWER]: Advancing to term 6
I20260808 13:48:02.173754 20104 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 3 FOLLOWER]: Advancing to term 4
I20260808 13:48:02.175653 19713 ts_manager.cc:194] Re-registered known tserver with Master: bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:02.179463 19621 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8034ed4c5804b538b25282ddf38e46e in term 6.
I20260808 13:48:02.169492 20062 leader_election.cc:290] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [CANDIDATE]: Term 6 election: Requested vote from peers b5e2d9219789424c809f622aff07d3f7 (127.16.219.254:37813), 43efdd0c2d224907a532c8f81d469c60 (127.16.219.252:36493)
I20260808 13:48:02.180540 19976 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8034ed4c5804b538b25282ddf38e46e. Latest consensus state: current_term: 6 leader_uuid: "c8034ed4c5804b538b25282ddf38e46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:48:02.181314 19976 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: This master's current role is: LEADER
I20260808 13:48:02.185336 20059 ts_tablet_manager.cc:1403] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd: Time spent bootstrapping tablet: real 0.112s user 0.053s sys 0.040s
I20260808 13:48:02.187949 20059 raft_consensus.cc:359] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 4 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:02.188618 20059 raft_consensus.cc:740] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: bad61df9bf4649639959aea33b6d7ccd, State: Initialized, Role: FOLLOWER
I20260808 13:48:02.189234 20059 consensus_queue.cc:260] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:02.191579 20059 ts_tablet_manager.cc:1434] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260808 13:48:02.196013 19961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:02.203357 19848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:02.205152 20046 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd; no voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a
I20260808 13:48:02.206190 20095 raft_consensus.cc:2749] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260808 13:48:02.239259 20104 raft_consensus.cc:3060] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 4 FOLLOWER]: Advancing to term 5
I20260808 13:48:02.267266 19621 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 6 FOLLOWER]: Refusing update from remote peer c8034ed4c5804b538b25282ddf38e46e: Log matching property violated. Preceding OpId in replica: term: 4 index: 23. Preceding OpId from leader: term: 6 index: 24. (index mismatch)
I20260808 13:48:02.268762 19976 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [LEADER]: Connected to new peer: Peer: permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 22, Time since last communication: 0.000s
I20260808 13:48:02.272003 20050 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8034ed4c5804b538b25282ddf38e46e. Latest consensus state: current_term: 6 leader_uuid: "c8034ed4c5804b538b25282ddf38e46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:48:02.272608 20050 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 13:48:02.276160 19976 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 6 leader_uuid: "c8034ed4c5804b538b25282ddf38e46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:48:02.276923 19976 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: This master's current role is: LEADER
I20260808 13:48:02.277274 19723 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 6 FOLLOWER]: Refusing update from remote peer c8034ed4c5804b538b25282ddf38e46e: Log matching property violated. Preceding OpId in replica: term: 4 index: 22. Preceding OpId from leader: term: 6 index: 24. (index mismatch)
I20260808 13:48:02.279665 20064 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 22, Time since last communication: 0.001s
I20260808 13:48:02.280843 20050 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "c8034ed4c5804b538b25282ddf38e46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:48:02.281567 20050 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 13:48:02.291252 20049 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8034ed4c5804b538b25282ddf38e46e. Latest consensus state: current_term: 6 leader_uuid: "c8034ed4c5804b538b25282ddf38e46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:48:02.291298 20154 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "c8034ed4c5804b538b25282ddf38e46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:48:02.292008 20049 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 13:48:02.292215 20154 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 13:48:02.291698 20147 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 13:48:02.301882 20147 catalog_manager.cc:679] Loaded metadata for table NewTableName [id=7a465016c4034f30bbaf5f5046e20548]
I20260808 13:48:02.306754 20147 tablet_loader.cc:96] loaded metadata for tablet 9ee2d1274d4841acb80fab840190d1f6 (table NewTableName [id=7a465016c4034f30bbaf5f5046e20548])
I20260808 13:48:02.307753 20147 tablet_loader.cc:96] loaded metadata for tablet ebb6c443eab04445a885a5150910d735 (table NewTableName [id=7a465016c4034f30bbaf5f5046e20548])
I20260808 13:48:02.308774 20147 tablet_loader.cc:96] loaded metadata for tablet f5931425868b4b63b910f7ceff47dc01 (table NewTableName [id=7a465016c4034f30bbaf5f5046e20548])
I20260808 13:48:02.309787 20147 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 13:48:02.312922 20147 catalog_manager.cc:1295] Loaded cluster ID: 89ddcd6e6f434b32a06787e9c40e4160
I20260808 13:48:02.313181 20147 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 13:48:02.316587 20147 catalog_manager.cc:1540] Loading token signing keys...
I20260808 13:48:02.327979 20147 catalog_manager.cc:6081] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e: Loaded TSK: 0
I20260808 13:48:02.329090 20147 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 13:48:02.398871 19976 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 6 leader_uuid: "c8034ed4c5804b538b25282ddf38e46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:48:02.399653 19976 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: This master's current role is: LEADER
I20260808 13:48:02.439594 19894 heartbeater.cc:499] Master 127.16.219.253:44897 was elected leader, sending a full tablet report...
I20260808 13:48:02.443738 20016 heartbeater.cc:499] Master 127.16.219.253:44897 was elected leader, sending a full tablet report...
I20260808 13:48:02.451901 18911 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39298
I20260808 13:48:02.451701 18913 catalog_manager.cc:5697] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a reported cstate change: term changed from 3 to 4, leader changed from bad61df9bf4649639959aea33b6d7ccd (127.16.219.195) to de942a19327e426b994b416686c1412a (127.16.219.193). New cstate: current_term: 4 leader_uuid: "de942a19327e426b994b416686c1412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } health_report { overall_health: HEALTHY } } }
I20260808 13:48:02.554451 20135 heartbeater.cc:499] Master 127.16.219.253:44897 was elected leader, sending a full tablet report...
W20260808 13:48:02.680406 18950 debug-util.cc:398] Leaking SignalData structure 0x7b0800154220 after lost signal to thread 17266
I20260808 13:48:06.917623 20164 raft_consensus.cc:493] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c8034ed4c5804b538b25282ddf38e46e)
I20260808 13:48:06.918673 20164 raft_consensus.cc:515] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:48:06.923297 20164 leader_election.cc:290] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b5e2d9219789424c809f622aff07d3f7 (127.16.219.254:37813), c8034ed4c5804b538b25282ddf38e46e (127.16.219.253:44897)
I20260808 13:48:06.924024 18924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "43efdd0c2d224907a532c8f81d469c60" candidate_term: 7 candidate_status { last_received { term: 6 index: 25 } } ignore_live_leader: false dest_uuid: "c8034ed4c5804b538b25282ddf38e46e" is_pre_election: true
I20260808 13:48:06.929517 20161 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:06.930331 20161 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:06.933722 20161 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:06.939532 20166 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader de942a19327e426b994b416686c1412a)
I20260808 13:48:06.940330 20166 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:06.943199 20167 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:06.946097 20167 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:06.947382 19848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:06.949138 20167 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:06.945447 20166 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:06.952472 19848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:06.953410 19848 raft_consensus.cc:2468] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bad61df9bf4649639959aea33b6d7ccd in term 5.
I20260808 13:48:06.961205 20046 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a; no voters:
I20260808 13:48:06.962728 20166 raft_consensus.cc:2804] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260808 13:48:06.963326 20166 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 5 FOLLOWER]: Starting leader election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:06.963923 20166 raft_consensus.cc:3060] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 5 FOLLOWER]: Advancing to term 6
I20260808 13:48:06.970120 20169 raft_consensus.cc:493] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c8034ed4c5804b538b25282ddf38e46e)
I20260808 13:48:06.972337 20169 raft_consensus.cc:515] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:48:06.975745 20169 leader_election.cc:290] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c8034ed4c5804b538b25282ddf38e46e (127.16.219.253:44897), 43efdd0c2d224907a532c8f81d469c60 (127.16.219.252:36493)
I20260808 13:48:06.976500 18924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e2d9219789424c809f622aff07d3f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 25 } } ignore_live_leader: false dest_uuid: "c8034ed4c5804b538b25282ddf38e46e" is_pre_election: true
I20260808 13:48:06.975513 20166 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:06.980492 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e2d9219789424c809f622aff07d3f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 25 } } ignore_live_leader: false dest_uuid: "43efdd0c2d224907a532c8f81d469c60" is_pre_election: true
I20260808 13:48:06.981109 20166 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 6 election: Requested vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:06.981367 19621 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5e2d9219789424c809f622aff07d3f7 in term 6.
I20260808 13:48:06.982445 19848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a"
I20260808 13:48:06.983567 19700 leader_election.cc:304] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43efdd0c2d224907a532c8f81d469c60, b5e2d9219789424c809f622aff07d3f7; no voters: c8034ed4c5804b538b25282ddf38e46e
I20260808 13:48:06.983743 19961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:06.984813 20169 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260808 13:48:06.985461 20169 raft_consensus.cc:493] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c8034ed4c5804b538b25282ddf38e46e)
I20260808 13:48:06.986141 20169 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 6 FOLLOWER]: Advancing to term 7
I20260808 13:48:06.993458 20166 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader de942a19327e426b994b416686c1412a)
I20260808 13:48:06.994364 20166 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:06.994715 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:06.995697 20104 raft_consensus.cc:2393] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de942a19327e426b994b416686c1412a in current term 6: Already voted for candidate bad61df9bf4649639959aea33b6d7ccd in this term.
I20260808 13:48:06.997532 20166 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:06.998482 19848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:06.998325 20169 raft_consensus.cc:515] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:48:07.002790 20169 leader_election.cc:290] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [CANDIDATE]: Term 7 election: Requested vote from peers c8034ed4c5804b538b25282ddf38e46e (127.16.219.253:44897), 43efdd0c2d224907a532c8f81d469c60 (127.16.219.252:36493)
I20260808 13:48:07.004251 20042 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader de942a19327e426b994b416686c1412a)
I20260808 13:48:07.005067 20042 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:07.009629 19791 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de942a19327e426b994b416686c1412a; no voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:48:07.011380 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e2d9219789424c809f622aff07d3f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 25 } } ignore_live_leader: false dest_uuid: "43efdd0c2d224907a532c8f81d469c60"
I20260808 13:48:07.012411 20042 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:07.011401 20161 raft_consensus.cc:3060] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 5 FOLLOWER]: Advancing to term 6
I20260808 13:48:07.014726 20042 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader de942a19327e426b994b416686c1412a)
I20260808 13:48:07.015563 20042 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:07.013494 19723 raft_consensus.cc:1240] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 7 FOLLOWER]: Rejecting Update request from peer c8034ed4c5804b538b25282ddf38e46e for earlier term 6. Current term is 7. Ops: []
I20260808 13:48:07.031629 20161 raft_consensus.cc:2749] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260808 13:48:07.030628 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:07.035893 19976 consensus_queue.cc:1059] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 }, Status: INVALID_TERM, Last received: 6.25, Next index: 26, Last known committed idx: 25, Time since last communication: 0.001s
I20260808 13:48:07.037299 19976 raft_consensus.cc:3055] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 6 LEADER]: Stepping down as leader of term 6
I20260808 13:48:07.037745 19976 raft_consensus.cc:740] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c8034ed4c5804b538b25282ddf38e46e, State: Running, Role: LEADER
I20260808 13:48:07.039266 19850 raft_consensus.cc:1240] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 6 FOLLOWER]: Rejecting Update request from peer d00890937b5046758a2fb3cd9c79e8ad for earlier term 5. Current term is 6. Ops: []
I20260808 13:48:07.038985 19976 consensus_queue.cc:260] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 6.25, Last appended by leader: 25, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:48:07.040380 19976 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 6 FOLLOWER]: Advancing to term 7
I20260808 13:48:07.040424 19847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:07.030047 19961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:07.042052 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:07.043207 20104 raft_consensus.cc:2468] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 4.
I20260808 13:48:07.043720 20170 consensus_queue.cc:1059] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 13:48:07.044724 20170 raft_consensus.cc:3055] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 5 LEADER]: Stepping down as leader of term 5
I20260808 13:48:07.031737 19959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:07.045032 20170 raft_consensus.cc:740] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d00890937b5046758a2fb3cd9c79e8ad, State: Running, Role: LEADER
I20260808 13:48:07.042078 19961 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bad61df9bf4649639959aea33b6d7ccd in term 4.
I20260808 13:48:07.045858 20170 consensus_queue.cc:260] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:07.047066 20170 raft_consensus.cc:3060] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 5 FOLLOWER]: Advancing to term 6
I20260808 13:48:07.033283 20103 raft_consensus.cc:1240] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 6 FOLLOWER]: Rejecting Update request from peer d00890937b5046758a2fb3cd9c79e8ad for earlier term 5. Current term is 6. Ops: []
I20260808 13:48:07.048707 18924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e2d9219789424c809f622aff07d3f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 25 } } ignore_live_leader: false dest_uuid: "c8034ed4c5804b538b25282ddf38e46e"
I20260808 13:48:07.047008 19848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:07.049960 19916 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad; no voters: de942a19327e426b994b416686c1412a
I20260808 13:48:07.050799 19723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "43efdd0c2d224907a532c8f81d469c60" candidate_term: 7 candidate_status { last_received { term: 6 index: 25 } } ignore_live_leader: false dest_uuid: "b5e2d9219789424c809f622aff07d3f7" is_pre_election: true
I20260808 13:48:07.051582 19916 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad; no voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a
I20260808 13:48:07.052047 19723 raft_consensus.cc:2393] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43efdd0c2d224907a532c8f81d469c60 in current term 7: Already voted for candidate b5e2d9219789424c809f622aff07d3f7 in this term.
I20260808 13:48:07.026541 20042 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:07.055115 20042 raft_consensus.cc:2749] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260808 13:48:07.055579 19594 leader_election.cc:304] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43efdd0c2d224907a532c8f81d469c60; no voters: b5e2d9219789424c809f622aff07d3f7, c8034ed4c5804b538b25282ddf38e46e
I20260808 13:48:07.058018 19960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:07.058554 20164 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 6 FOLLOWER]: Advancing to term 7
I20260808 13:48:07.056068 19961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad"
I20260808 13:48:07.053102 20171 raft_consensus.cc:2804] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260808 13:48:07.060189 20171 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 4 FOLLOWER]: Starting leader election (detected failure of leader de942a19327e426b994b416686c1412a)
I20260808 13:48:07.060879 20171 raft_consensus.cc:3060] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 4 FOLLOWER]: Advancing to term 5
I20260808 13:48:07.068910 20164 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260808 13:48:07.071636 20046 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad; no voters: de942a19327e426b994b416686c1412a
I20260808 13:48:07.071709 18924 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5e2d9219789424c809f622aff07d3f7 in term 7.
I20260808 13:48:07.072762 20166 raft_consensus.cc:2804] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260808 13:48:07.073151 20166 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 4 FOLLOWER]: Starting leader election (detected failure of leader de942a19327e426b994b416686c1412a)
I20260808 13:48:07.073576 20166 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 4 FOLLOWER]: Advancing to term 5
I20260808 13:48:07.075857 19961 raft_consensus.cc:2468] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bad61df9bf4649639959aea33b6d7ccd in term 6.
I20260808 13:48:07.080979 20166 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:07.081696 20171 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:07.082608 20046 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd; no voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a
I20260808 13:48:07.083837 20167 raft_consensus.cc:2749] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260808 13:48:07.084408 20046 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad; no voters: de942a19327e426b994b416686c1412a
I20260808 13:48:07.084774 20171 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 5 election: Requested vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:07.085976 20167 raft_consensus.cc:2804] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 6 FOLLOWER]: Leader election won for term 6
I20260808 13:48:07.086551 19698 leader_election.cc:304] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5e2d9219789424c809f622aff07d3f7, c8034ed4c5804b538b25282ddf38e46e; no voters: 43efdd0c2d224907a532c8f81d469c60
I20260808 13:48:07.086951 19848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a"
I20260808 13:48:07.088645 20166 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 5 election: Requested vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:07.087909 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd"
I20260808 13:48:07.090637 19847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a"
I20260808 13:48:07.091462 20169 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 7 FOLLOWER]: Leader election won for term 7
I20260808 13:48:07.094255 19916 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad; no voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a
I20260808 13:48:07.095548 20171 raft_consensus.cc:2749] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260808 13:48:07.096715 19961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad"
I20260808 13:48:07.098299 20169 raft_consensus.cc:697] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 7 LEADER]: Becoming Leader. State: Replica: b5e2d9219789424c809f622aff07d3f7, State: Running, Role: LEADER
I20260808 13:48:07.098953 20046 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd; no voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a
I20260808 13:48:07.099961 20167 raft_consensus.cc:697] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 6 LEADER]: Becoming Leader. State: Replica: bad61df9bf4649639959aea33b6d7ccd, State: Running, Role: LEADER
I20260808 13:48:07.100135 20166 raft_consensus.cc:2749] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260808 13:48:07.099808 20169 consensus_queue.cc:237] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 6.25, Last appended by leader: 25, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:48:07.101469 20167 consensus_queue.cc:237] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:07.109088 20176 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5e2d9219789424c809f622aff07d3f7. Latest consensus state: current_term: 7 leader_uuid: "b5e2d9219789424c809f622aff07d3f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:48:07.109989 20176 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: This master's current role is: LEADER
I20260808 13:48:07.115998 20179 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 13:48:07.125447 20179 catalog_manager.cc:679] Loaded metadata for table NewTableName [id=7a465016c4034f30bbaf5f5046e20548]
I20260808 13:48:07.132432 20179 tablet_loader.cc:96] loaded metadata for tablet 9ee2d1274d4841acb80fab840190d1f6 (table NewTableName [id=7a465016c4034f30bbaf5f5046e20548])
I20260808 13:48:07.134050 20179 tablet_loader.cc:96] loaded metadata for tablet ebb6c443eab04445a885a5150910d735 (table NewTableName [id=7a465016c4034f30bbaf5f5046e20548])
I20260808 13:48:07.135980 20179 tablet_loader.cc:96] loaded metadata for tablet f5931425868b4b63b910f7ceff47dc01 (table NewTableName [id=7a465016c4034f30bbaf5f5046e20548])
I20260808 13:48:07.137372 20179 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 13:48:07.142905 20179 catalog_manager.cc:1295] Loaded cluster ID: 89ddcd6e6f434b32a06787e9c40e4160
I20260808 13:48:07.143208 20179 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 13:48:07.149083 20179 catalog_manager.cc:1540] Loading token signing keys...
I20260808 13:48:07.151697 19961 raft_consensus.cc:1240] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 5 FOLLOWER]: Rejecting Update request from peer de942a19327e426b994b416686c1412a for earlier term 4. Current term is 5. Ops: []
I20260808 13:48:07.152830 20103 raft_consensus.cc:1240] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 5 FOLLOWER]: Rejecting Update request from peer de942a19327e426b994b416686c1412a for earlier term 4. Current term is 5. Ops: []
I20260808 13:48:07.154831 20161 consensus_queue.cc:1059] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260808 13:48:07.155824 20158 consensus_queue.cc:1059] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260808 13:48:07.156610 20173 raft_consensus.cc:3055] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 4 LEADER]: Stepping down as leader of term 4
I20260808 13:48:07.157162 20173 raft_consensus.cc:740] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: de942a19327e426b994b416686c1412a, State: Running, Role: LEADER
I20260808 13:48:07.157403 20161 raft_consensus.cc:3055] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 4 LEADER]: Stepping down as leader of term 4
I20260808 13:48:07.157912 20161 raft_consensus.cc:740] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: de942a19327e426b994b416686c1412a, State: Running, Role: LEADER
I20260808 13:48:07.158680 20179 catalog_manager.cc:6081] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7: Loaded TSK: 0
I20260808 13:48:07.158432 20173 consensus_queue.cc:260] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:07.159917 20179 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 13:48:07.159191 20161 consensus_queue.cc:260] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:07.160705 20173 raft_consensus.cc:3060] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 4 FOLLOWER]: Advancing to term 5
I20260808 13:48:07.161142 20161 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 4 FOLLOWER]: Advancing to term 5
I20260808 13:48:07.181447 19847 raft_consensus.cc:1275] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 6 FOLLOWER]: Refusing update from remote peer bad61df9bf4649639959aea33b6d7ccd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260808 13:48:07.183701 20167 consensus_queue.cc:1048] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260808 13:48:07.185611 19621 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 7 FOLLOWER]: Refusing update from remote peer b5e2d9219789424c809f622aff07d3f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 25. Preceding OpId from leader: term: 7 index: 26. (index mismatch)
I20260808 13:48:07.188076 20176 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.001s
I20260808 13:48:07.196475 20164 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5e2d9219789424c809f622aff07d3f7. Latest consensus state: current_term: 7 leader_uuid: "b5e2d9219789424c809f622aff07d3f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:48:07.197214 20164 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 13:48:07.200103 18924 raft_consensus.cc:1275] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 7 FOLLOWER]: Refusing update from remote peer b5e2d9219789424c809f622aff07d3f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 25. Preceding OpId from leader: term: 7 index: 26. (index mismatch)
I20260808 13:48:07.202255 20176 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20260808 13:48:07.203353 19712 catalog_manager.cc:5697] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a reported cstate change: term changed from 5 to 6, leader changed from d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194) to bad61df9bf4649639959aea33b6d7ccd (127.16.219.195). New cstate: current_term: 6 leader_uuid: "bad61df9bf4649639959aea33b6d7ccd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } }
I20260808 13:48:07.206629 20169 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 7 leader_uuid: "b5e2d9219789424c809f622aff07d3f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:48:07.207609 20169 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: This master's current role is: LEADER
I20260808 13:48:07.215591 19976 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5e2d9219789424c809f622aff07d3f7. Latest consensus state: current_term: 7 leader_uuid: "b5e2d9219789424c809f622aff07d3f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:48:07.216130 19976 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: This master's current role is: FOLLOWER
I20260808 13:48:07.220618 20176 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 7 leader_uuid: "b5e2d9219789424c809f622aff07d3f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:48:07.221686 20176 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: This master's current role is: LEADER
I20260808 13:48:07.225656 19961 raft_consensus.cc:1275] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 6 FOLLOWER]: Refusing update from remote peer bad61df9bf4649639959aea33b6d7ccd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260808 13:48:07.228014 20167 consensus_queue.cc:1048] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260808 13:48:07.238296 20017 heartbeater.cc:499] Master 127.16.219.254:37813 was elected leader, sending a full tablet report...
I20260808 13:48:07.253575 20136 heartbeater.cc:499] Master 127.16.219.254:37813 was elected leader, sending a full tablet report...
I20260808 13:48:07.258136 19976 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "b5e2d9219789424c809f622aff07d3f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:48:07.259018 19976 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: This master's current role is: FOLLOWER
I20260808 13:48:07.259018 20164 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "b5e2d9219789424c809f622aff07d3f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:48:07.264240 20164 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 13:48:07.303447 19895 heartbeater.cc:499] Master 127.16.219.254:37813 was elected leader, sending a full tablet report...
I20260808 13:48:07.316725 20171 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 13:48:07.317504 20171 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:07.321842 19847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:07.322793 19847 raft_consensus.cc:2468] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 5.
I20260808 13:48:07.322990 20171 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:07.323611 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:07.324352 20103 raft_consensus.cc:2468] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 4.
I20260808 13:48:07.324533 19916 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a; no voters:
I20260808 13:48:07.326057 20171 raft_consensus.cc:2804] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260808 13:48:07.326581 20171 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 13:48:07.327076 20171 raft_consensus.cc:3060] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 5 FOLLOWER]: Advancing to term 6
I20260808 13:48:07.332551 20171 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:07.334512 20171 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 6 election: Requested vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:07.336545 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd"
I20260808 13:48:07.337196 20103 raft_consensus.cc:3060] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 4 FOLLOWER]: Advancing to term 6
I20260808 13:48:07.338651 19847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a"
I20260808 13:48:07.339313 19847 raft_consensus.cc:3060] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 5 FOLLOWER]: Advancing to term 6
I20260808 13:48:07.349493 19847 raft_consensus.cc:2468] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 6.
I20260808 13:48:07.351841 19916 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a; no voters:
I20260808 13:48:07.352958 20171 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader de942a19327e426b994b416686c1412a)
I20260808 13:48:07.353538 20171 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:07.353808 20174 raft_consensus.cc:2804] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 6 FOLLOWER]: Leader election won for term 6
I20260808 13:48:07.354710 20174 raft_consensus.cc:697] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 6 LEADER]: Becoming Leader. State: Replica: d00890937b5046758a2fb3cd9c79e8ad, State: Running, Role: LEADER
I20260808 13:48:07.356119 20174 consensus_queue.cc:237] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:07.356135 20103 raft_consensus.cc:2468] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 6.
I20260808 13:48:07.358197 19847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:07.359973 20171 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:07.360914 19847 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 5.
I20260808 13:48:07.361588 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:07.363092 19916 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a; no voters:
I20260808 13:48:07.363430 20175 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 13:48:07.364102 20171 raft_consensus.cc:2804] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260808 13:48:07.364850 20171 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 4 FOLLOWER]: Starting leader election (detected failure of leader de942a19327e426b994b416686c1412a)
I20260808 13:48:07.364254 20175 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:07.366505 20171 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 4 FOLLOWER]: Advancing to term 5
I20260808 13:48:07.367538 20175 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:07.369410 19847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:07.370033 19847 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bad61df9bf4649639959aea33b6d7ccd in term 5.
I20260808 13:48:07.370316 19961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:07.371272 20046 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a; no voters:
I20260808 13:48:07.372373 19714 catalog_manager.cc:5697] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad reported cstate change: term changed from 4 to 6, leader changed from de942a19327e426b994b416686c1412a (127.16.219.193) to d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194). New cstate: current_term: 6 leader_uuid: "d00890937b5046758a2fb3cd9c79e8ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } health_report { overall_health: UNKNOWN } } }
I20260808 13:48:07.380846 20171 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:07.382196 19961 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bad61df9bf4649639959aea33b6d7ccd in term 5.
I20260808 13:48:07.383031 20171 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 5 election: Requested vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:07.383955 20103 raft_consensus.cc:2393] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d00890937b5046758a2fb3cd9c79e8ad in current term 5: Already voted for candidate bad61df9bf4649639959aea33b6d7ccd in this term.
I20260808 13:48:07.384433 20175 raft_consensus.cc:2804] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260808 13:48:07.386204 20175 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 13:48:07.386611 20175 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 5 FOLLOWER]: Advancing to term 6
I20260808 13:48:07.387022 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd"
I20260808 13:48:07.388734 19847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a"
I20260808 13:48:07.393628 20175 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:07.395330 20104 raft_consensus.cc:2368] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d00890937b5046758a2fb3cd9c79e8ad for earlier term 5. Current term is 6.
I20260808 13:48:07.397048 19847 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 5.
I20260808 13:48:07.398764 19916 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a; no voters:
I20260808 13:48:07.399555 20175 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 6 election: Requested vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:07.399997 19916 leader_election.cc:400] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 5 election: Vote denied by peer bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613) with higher term. Message: Invalid argument: T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d00890937b5046758a2fb3cd9c79e8ad for earlier term 5. Current term is 6.
I20260808 13:48:07.401110 19961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad"
I20260808 13:48:07.401026 20171 raft_consensus.cc:2804] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 5 FOLLOWER]: Leader election won for term 5
I20260808 13:48:07.402242 20171 raft_consensus.cc:697] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 5 LEADER]: Becoming Leader. State: Replica: d00890937b5046758a2fb3cd9c79e8ad, State: Running, Role: LEADER
I20260808 13:48:07.403573 20171 consensus_queue.cc:237] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:07.404692 19847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a"
I20260808 13:48:07.405532 19847 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 5 FOLLOWER]: Advancing to term 6
I20260808 13:48:07.415755 19847 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bad61df9bf4649639959aea33b6d7ccd in term 6.
I20260808 13:48:07.418535 20046 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a; no voters:
I20260808 13:48:07.419723 20175 raft_consensus.cc:2804] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 6 FOLLOWER]: Leader election won for term 6
I20260808 13:48:07.420485 20175 raft_consensus.cc:697] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 6 LEADER]: Becoming Leader. State: Replica: bad61df9bf4649639959aea33b6d7ccd, State: Running, Role: LEADER
I20260808 13:48:07.419914 19714 catalog_manager.cc:5697] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad reported cstate change: term changed from 4 to 5, leader changed from de942a19327e426b994b416686c1412a (127.16.219.193) to d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194). New cstate: current_term: 5 leader_uuid: "d00890937b5046758a2fb3cd9c79e8ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } health_report { overall_health: UNKNOWN } } }
I20260808 13:48:07.421851 20175 consensus_queue.cc:237] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:07.449213 20104 raft_consensus.cc:1275] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 6 FOLLOWER]: Refusing update from remote peer d00890937b5046758a2fb3cd9c79e8ad: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260808 13:48:07.449837 19712 catalog_manager.cc:5697] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd reported cstate change: term changed from 5 to 6, leader changed from d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194) to bad61df9bf4649639959aea33b6d7ccd (127.16.219.195). New cstate: current_term: 6 leader_uuid: "bad61df9bf4649639959aea33b6d7ccd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } health_report { overall_health: HEALTHY } } }
I20260808 13:48:07.451083 20171 consensus_queue.cc:1048] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260808 13:48:07.457719 19847 raft_consensus.cc:1275] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 6 FOLLOWER]: Refusing update from remote peer d00890937b5046758a2fb3cd9c79e8ad: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260808 13:48:07.460217 20171 consensus_queue.cc:1048] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260808 13:48:07.511456 20103 raft_consensus.cc:1240] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 6 LEADER]: Rejecting Update request from peer d00890937b5046758a2fb3cd9c79e8ad for earlier term 5. Current term is 6. Ops: []
I20260808 13:48:07.515983 20042 consensus_queue.cc:1059] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260808 13:48:07.516965 20042 consensus_queue.cc:1243] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Peer bad61df9bf4649639959aea33b6d7ccd log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260808 13:48:07.517596 20042 raft_consensus.cc:3055] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 5 LEADER]: Stepping down as leader of term 5
I20260808 13:48:07.518114 20042 raft_consensus.cc:740] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d00890937b5046758a2fb3cd9c79e8ad, State: Running, Role: LEADER
I20260808 13:48:07.519402 20042 consensus_queue.cc:260] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:07.521171 20042 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 5 FOLLOWER]: Advancing to term 6
I20260808 13:48:07.545710 19961 raft_consensus.cc:1275] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 6 FOLLOWER]: Refusing update from remote peer bad61df9bf4649639959aea33b6d7ccd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260808 13:48:07.546046 19961 pending_rounds.cc:85] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad: Aborting all ops after (but not including) 6
I20260808 13:48:07.546373 19961 pending_rounds.cc:107] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260808 13:48:07.546643 19961 raft_consensus.cc:2889] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260808 13:48:07.547979 20167 consensus_queue.cc:1048] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260808 13:48:07.550895 19848 raft_consensus.cc:1275] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 6 FOLLOWER]: Refusing update from remote peer bad61df9bf4649639959aea33b6d7ccd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260808 13:48:07.554899 20167 consensus_queue.cc:1048] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260808 13:48:07.815012 18950 debug-util.cc:398] Leaking SignalData structure 0x7b08001d24c0 after lost signal to thread 17266
W20260808 13:48:07.815999 18950 debug-util.cc:398] Leaking SignalData structure 0x7b08001d2c00 after lost signal to thread 18953
W20260808 13:48:07.816888 18950 debug-util.cc:398] Leaking SignalData structure 0x7b08000ced60 after lost signal to thread 19647
W20260808 13:48:07.817710 18950 debug-util.cc:398] Leaking SignalData structure 0x7b0800153720 after lost signal to thread 19752
W20260808 13:48:07.818634 18950 debug-util.cc:398] Leaking SignalData structure 0x7b08001e36e0 after lost signal to thread 19892
W20260808 13:48:07.819445 18950 debug-util.cc:398] Leaking SignalData structure 0x7b080025a980 after lost signal to thread 20014
W20260808 13:48:07.820354 18950 debug-util.cc:398] Leaking SignalData structure 0x7b08001810a0 after lost signal to thread 20133
I20260808 13:48:10.415931 20207 raft_consensus.cc:493] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5e2d9219789424c809f622aff07d3f7)
I20260808 13:48:10.417322 20207 raft_consensus.cc:515] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:48:10.420073 20207 leader_election.cc:290] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5e2d9219789424c809f622aff07d3f7 (127.16.219.254:37813), 43efdd0c2d224907a532c8f81d469c60 (127.16.219.252:36493)
I20260808 13:48:10.422612 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8034ed4c5804b538b25282ddf38e46e" candidate_term: 8 candidate_status { last_received { term: 7 index: 30 } } ignore_live_leader: false dest_uuid: "43efdd0c2d224907a532c8f81d469c60" is_pre_election: true
I20260808 13:48:10.458643 20208 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bad61df9bf4649639959aea33b6d7ccd)
I20260808 13:48:10.459312 20208 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:10.460707 20209 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bad61df9bf4649639959aea33b6d7ccd)
I20260808 13:48:10.461374 20209 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:10.461851 20208 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:10.464718 19961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:10.465401 20209 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:10.468001 19961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:10.468587 19961 raft_consensus.cc:2468] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de942a19327e426b994b416686c1412a in term 6.
I20260808 13:48:10.469906 19791 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a; no voters:
I20260808 13:48:10.470752 20209 raft_consensus.cc:2804] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260808 13:48:10.471138 20209 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 6 FOLLOWER]: Starting leader election (detected failure of leader bad61df9bf4649639959aea33b6d7ccd)
I20260808 13:48:10.471529 20209 raft_consensus.cc:3060] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 6 FOLLOWER]: Advancing to term 7
I20260808 13:48:10.471282 20174 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bad61df9bf4649639959aea33b6d7ccd)
I20260808 13:48:10.472301 20174 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:10.479789 19847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:10.480508 20174 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613), de942a19327e426b994b416686c1412a (127.16.219.193:40615)
I20260808 13:48:10.482000 19723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8034ed4c5804b538b25282ddf38e46e" candidate_term: 8 candidate_status { last_received { term: 7 index: 30 } } ignore_live_leader: false dest_uuid: "b5e2d9219789424c809f622aff07d3f7" is_pre_election: true
I20260808 13:48:10.484071 18897 leader_election.cc:304] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8034ed4c5804b538b25282ddf38e46e; no voters: 43efdd0c2d224907a532c8f81d469c60, b5e2d9219789424c809f622aff07d3f7
I20260808 13:48:10.484604 20209 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:10.485424 20207 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260808 13:48:10.486745 20209 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 7 election: Requested vote from peers bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:10.488340 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:10.488528 19961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad"
I20260808 13:48:10.489218 19961 raft_consensus.cc:3060] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 6 FOLLOWER]: Advancing to term 7
I20260808 13:48:10.490092 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:10.491016 19847 raft_consensus.cc:2393] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d00890937b5046758a2fb3cd9c79e8ad in current term 7: Already voted for candidate de942a19327e426b994b416686c1412a in this term.
I20260808 13:48:10.492556 19791 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de942a19327e426b994b416686c1412a; no voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:48:10.489279 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd"
I20260808 13:48:10.485522 20174 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bad61df9bf4649639959aea33b6d7ccd)
I20260808 13:48:10.496341 20174 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:10.497730 19961 raft_consensus.cc:2468] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de942a19327e426b994b416686c1412a in term 7.
I20260808 13:48:10.499027 20209 raft_consensus.cc:2749] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260808 13:48:10.499362 20206 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:10.500545 19791 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a; no voters: bad61df9bf4649639959aea33b6d7ccd
I20260808 13:48:10.499949 20206 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:10.502697 20212 raft_consensus.cc:493] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5e2d9219789424c809f622aff07d3f7)
I20260808 13:48:10.503046 20208 raft_consensus.cc:2804] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 7 FOLLOWER]: Leader election won for term 7
I20260808 13:48:10.503314 20212 raft_consensus.cc:515] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:48:10.501760 20209 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:10.505616 19850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:10.506129 20212 leader_election.cc:290] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5e2d9219789424c809f622aff07d3f7 (127.16.219.254:37813), c8034ed4c5804b538b25282ddf38e46e (127.16.219.253:44897)
I20260808 13:48:10.506875 19723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "43efdd0c2d224907a532c8f81d469c60" candidate_term: 8 candidate_status { last_received { term: 7 index: 30 } } ignore_live_leader: false dest_uuid: "b5e2d9219789424c809f622aff07d3f7" is_pre_election: true
I20260808 13:48:10.507441 18924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "43efdd0c2d224907a532c8f81d469c60" candidate_term: 8 candidate_status { last_received { term: 7 index: 30 } } ignore_live_leader: false dest_uuid: "c8034ed4c5804b538b25282ddf38e46e" is_pre_election: true
I20260808 13:48:10.505970 20209 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:10.507452 19846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:10.509948 19850 raft_consensus.cc:2468] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bad61df9bf4649639959aea33b6d7ccd in term 6.
I20260808 13:48:10.511098 20209 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:10.511071 19595 leader_election.cc:304] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43efdd0c2d224907a532c8f81d469c60; no voters: b5e2d9219789424c809f622aff07d3f7, c8034ed4c5804b538b25282ddf38e46e
I20260808 13:48:10.513243 19961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:10.513506 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:10.514168 20102 raft_consensus.cc:2468] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de942a19327e426b994b416686c1412a in term 6.
I20260808 13:48:10.515144 20046 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a; no voters:
I20260808 13:48:10.515718 20174 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:10.516297 20167 raft_consensus.cc:2804] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260808 13:48:10.516670 20167 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 6 FOLLOWER]: Starting leader election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:10.515208 19791 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a; no voters:
I20260808 13:48:10.517059 20167 raft_consensus.cc:3060] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 6 FOLLOWER]: Advancing to term 7
I20260808 13:48:10.517422 20212 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260808 13:48:10.517841 20209 raft_consensus.cc:2804] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260808 13:48:10.518301 20209 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 6 FOLLOWER]: Starting leader election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:10.518795 20209 raft_consensus.cc:3060] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 6 FOLLOWER]: Advancing to term 7
I20260808 13:48:10.521147 20208 raft_consensus.cc:697] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 7 LEADER]: Becoming Leader. State: Replica: de942a19327e426b994b416686c1412a, State: Running, Role: LEADER
I20260808 13:48:10.522344 20208 consensus_queue.cc:237] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:10.523289 20167 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:10.524977 20167 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 7 election: Requested vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:10.505584 20206 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:10.526607 19847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a"
I20260808 13:48:10.526901 20209 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:10.528524 19847 raft_consensus.cc:2393] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bad61df9bf4649639959aea33b6d7ccd in current term 7: Already voted for candidate de942a19327e426b994b416686c1412a in this term.
I20260808 13:48:10.530768 19961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad"
I20260808 13:48:10.532437 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd"
I20260808 13:48:10.533504 20102 raft_consensus.cc:2393] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate de942a19327e426b994b416686c1412a in current term 7: Already voted for candidate bad61df9bf4649639959aea33b6d7ccd in this term.
I20260808 13:48:10.536721 19791 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de942a19327e426b994b416686c1412a; no voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:48:10.537420 20208 raft_consensus.cc:2749] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260808 13:48:10.538060 19848 raft_consensus.cc:1240] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 7 LEADER]: Rejecting Update request from peer bad61df9bf4649639959aea33b6d7ccd for earlier term 6. Current term is 7. Ops: []
I20260808 13:48:10.539191 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:10.540795 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:10.542658 20102 raft_consensus.cc:1240] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 7 FOLLOWER]: Rejecting Update request from peer d00890937b5046758a2fb3cd9c79e8ad for earlier term 6. Current term is 7. Ops: []
I20260808 13:48:10.537452 20209 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 7 election: Requested vote from peers d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:10.546572 19961 raft_consensus.cc:1240] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 7 FOLLOWER]: Rejecting Update request from peer bad61df9bf4649639959aea33b6d7ccd for earlier term 6. Current term is 7. Ops: []
I20260808 13:48:10.546914 19959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:10.547164 19960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad"
I20260808 13:48:10.548655 19916 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad; no voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a
I20260808 13:48:10.549353 20174 raft_consensus.cc:2749] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260808 13:48:10.545636 19714 catalog_manager.cc:5697] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a reported cstate change: term changed from 6 to 7, leader changed from bad61df9bf4649639959aea33b6d7ccd (127.16.219.195) to de942a19327e426b994b416686c1412a (127.16.219.193). New cstate: current_term: 7 leader_uuid: "de942a19327e426b994b416686c1412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } health_report { overall_health: UNKNOWN } } }
I20260808 13:48:10.550591 19916 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad; no voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a
I20260808 13:48:10.551481 20210 raft_consensus.cc:2749] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260808 13:48:10.551635 19848 raft_consensus.cc:1240] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 7 FOLLOWER]: Rejecting Update request from peer d00890937b5046758a2fb3cd9c79e8ad for earlier term 6. Current term is 7. Ops: []
I20260808 13:48:10.552034 20174 consensus_queue.cc:1059] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 13:48:10.553228 20174 consensus_queue.cc:1059] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 13:48:10.553718 20211 consensus_queue.cc:1059] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260808 13:48:10.553221 20210 raft_consensus.cc:3055] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 6 LEADER]: Stepping down as leader of term 6
I20260808 13:48:10.554992 20210 raft_consensus.cc:740] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d00890937b5046758a2fb3cd9c79e8ad, State: Running, Role: LEADER
I20260808 13:48:10.555542 20046 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd; no voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a
I20260808 13:48:10.555037 20211 consensus_queue.cc:1243] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Peer de942a19327e426b994b416686c1412a log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260808 13:48:10.557164 20206 consensus_queue.cc:1059] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260808 13:48:10.561249 20206 raft_consensus.cc:2749] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260808 13:48:10.556560 20210 consensus_queue.cc:260] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:10.563594 20210 raft_consensus.cc:3060] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 6 FOLLOWER]: Advancing to term 7
I20260808 13:48:10.564880 20167 raft_consensus.cc:3055] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 6 LEADER]: Stepping down as leader of term 6
I20260808 13:48:10.565397 20167 raft_consensus.cc:740] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bad61df9bf4649639959aea33b6d7ccd, State: Running, Role: LEADER
I20260808 13:48:10.566545 20167 consensus_queue.cc:260] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:10.568465 20167 raft_consensus.cc:3060] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 6 FOLLOWER]: Advancing to term 7
I20260808 13:48:10.624769 20102 raft_consensus.cc:1275] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 7 FOLLOWER]: Refusing update from remote peer de942a19327e426b994b416686c1412a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260808 13:48:10.626168 20209 consensus_queue.cc:1048] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260808 13:48:10.641135 19960 raft_consensus.cc:1275] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 7 FOLLOWER]: Refusing update from remote peer de942a19327e426b994b416686c1412a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260808 13:48:10.643332 20208 consensus_queue.cc:1048] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260808 13:48:10.758589 20210 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 13:48:10.759065 20210 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:10.760630 20210 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:10.761253 19848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:10.761523 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:10.761754 19848 raft_consensus.cc:2468] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 7.
I20260808 13:48:10.762224 20102 raft_consensus.cc:2468] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 7.
I20260808 13:48:10.763221 19916 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a; no voters:
I20260808 13:48:10.764797 20210 raft_consensus.cc:2804] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260808 13:48:10.765231 20210 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 13:48:10.765561 20210 raft_consensus.cc:3060] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 7 FOLLOWER]: Advancing to term 8
I20260808 13:48:10.773172 20210 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:10.775024 20210 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 8 election: Requested vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:10.775604 19848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a"
I20260808 13:48:10.775974 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd"
I20260808 13:48:10.776271 19848 raft_consensus.cc:3060] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 7 FOLLOWER]: Advancing to term 8
I20260808 13:48:10.776543 20102 raft_consensus.cc:3060] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 7 FOLLOWER]: Advancing to term 8
I20260808 13:48:10.781046 19848 raft_consensus.cc:2468] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 8.
I20260808 13:48:10.781762 20102 raft_consensus.cc:2468] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 8.
I20260808 13:48:10.782020 19916 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a; no voters:
I20260808 13:48:10.782786 20210 raft_consensus.cc:2804] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 8 FOLLOWER]: Leader election won for term 8
I20260808 13:48:10.783257 20210 raft_consensus.cc:697] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 8 LEADER]: Becoming Leader. State: Replica: d00890937b5046758a2fb3cd9c79e8ad, State: Running, Role: LEADER
I20260808 13:48:10.783987 20210 consensus_queue.cc:237] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:10.792539 19712 catalog_manager.cc:5697] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "d00890937b5046758a2fb3cd9c79e8ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } health_report { overall_health: UNKNOWN } } }
I20260808 13:48:10.879427 19848 raft_consensus.cc:1275] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 8 FOLLOWER]: Refusing update from remote peer d00890937b5046758a2fb3cd9c79e8ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260808 13:48:10.880578 20210 consensus_queue.cc:1048] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 13:48:10.895121 20102 raft_consensus.cc:1275] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 8 FOLLOWER]: Refusing update from remote peer d00890937b5046758a2fb3cd9c79e8ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260808 13:48:10.900055 20174 consensus_queue.cc:1048] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 13:48:11.197221 20216 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 7 FOLLOWER]: Starting pre-election (detected failure of leader de942a19327e426b994b416686c1412a)
I20260808 13:48:11.198014 20216 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:11.201289 20216 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613), de942a19327e426b994b416686c1412a (127.16.219.193:40615)
I20260808 13:48:11.326560 20174 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bad61df9bf4649639959aea33b6d7ccd)
I20260808 13:48:11.327335 20174 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:11.329916 20174 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:11.512410 20237 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:11.513281 20237 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:11.529395 19960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:11.361595 20240 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader de942a19327e426b994b416686c1412a)
I20260808 13:48:11.544487 20240 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:11.547230 20240 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:11.560904 19960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:11.750721 19960 raft_consensus.cc:2468] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bad61df9bf4649639959aea33b6d7ccd in term 7.
I20260808 13:48:11.752154 20046 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad; no voters:
I20260808 13:48:11.753801 20240 raft_consensus.cc:2804] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260808 13:48:11.754230 20240 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 7 FOLLOWER]: Starting leader election (detected failure of leader de942a19327e426b994b416686c1412a)
I20260808 13:48:11.754640 20240 raft_consensus.cc:3060] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 7 FOLLOWER]: Advancing to term 8
I20260808 13:48:11.714847 20237 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:11.755370 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:11.755716 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:11.763352 20240 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:11.764490 20102 raft_consensus.cc:2393] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d00890937b5046758a2fb3cd9c79e8ad in current term 8: Already voted for candidate bad61df9bf4649639959aea33b6d7ccd in this term.
I20260808 13:48:11.766131 20240 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 8 election: Requested vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:11.767409 19960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad"
I20260808 13:48:11.768040 19960 raft_consensus.cc:3060] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 7 FOLLOWER]: Advancing to term 8
I20260808 13:48:11.776785 19960 raft_consensus.cc:2468] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bad61df9bf4649639959aea33b6d7ccd in term 8.
I20260808 13:48:11.778534 20046 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad; no voters:
I20260808 13:48:11.779663 20240 raft_consensus.cc:2804] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 8 FOLLOWER]: Leader election won for term 8
I20260808 13:48:11.780793 20240 raft_consensus.cc:697] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 8 LEADER]: Becoming Leader. State: Replica: bad61df9bf4649639959aea33b6d7ccd, State: Running, Role: LEADER
I20260808 13:48:11.781976 20240 consensus_queue.cc:237] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
W20260808 13:48:11.784730 19916 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.219.195:44613 timed out after 0.244s (SENT) [suppressed 47 similar messages]
I20260808 13:48:11.798216 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:11.815088 20242 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:11.815987 19960 raft_consensus.cc:1240] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 8 FOLLOWER]: Rejecting Update request from peer de942a19327e426b994b416686c1412a for earlier term 7. Current term is 8. Ops: []
I20260808 13:48:11.815660 20242 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:11.817459 20244 raft_consensus.cc:493] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5e2d9219789424c809f622aff07d3f7)
I20260808 13:48:11.817966 20244 raft_consensus.cc:515] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:48:11.818881 20242 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:11.819407 20242 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bad61df9bf4649639959aea33b6d7ccd)
I20260808 13:48:11.819865 20242 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:11.822479 20244 leader_election.cc:290] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5e2d9219789424c809f622aff07d3f7 (127.16.219.254:37813), c8034ed4c5804b538b25282ddf38e46e (127.16.219.253:44897)
I20260808 13:48:11.823592 20248 consensus_queue.cc:1059] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260808 13:48:11.821911 20242 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:11.824647 20242 raft_consensus.cc:3055] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 7 LEADER]: Stepping down as leader of term 7
I20260808 13:48:11.824931 20242 raft_consensus.cc:740] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: de942a19327e426b994b416686c1412a, State: Running, Role: LEADER
I20260808 13:48:11.825655 20242 consensus_queue.cc:260] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:11.844693 19960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:11.845392 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
W20260808 13:48:11.851193 19643 debug-util.cc:398] Leaking SignalData structure 0x7b08000c41e0 after lost signal to thread 17266
W20260808 13:48:11.852331 19643 debug-util.cc:398] Leaking SignalData structure 0x7b080016a460 after lost signal to thread 18953
I20260808 13:48:11.852283 19960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:11.853098 19960 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de942a19327e426b994b416686c1412a in term 6.
W20260808 13:48:11.853744 19643 debug-util.cc:398] Leaking SignalData structure 0x7b08001a0aa0 after lost signal to thread 19647
I20260808 13:48:11.854964 19723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "43efdd0c2d224907a532c8f81d469c60" candidate_term: 8 candidate_status { last_received { term: 7 index: 32 } } ignore_live_leader: false dest_uuid: "b5e2d9219789424c809f622aff07d3f7" is_pre_election: true
I20260808 13:48:11.856395 20103 raft_consensus.cc:1240] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 8 LEADER]: Rejecting Update request from peer de942a19327e426b994b416686c1412a for earlier term 7. Current term is 8. Ops: []
I20260808 13:48:11.855129 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
W20260808 13:48:11.855127 19643 debug-util.cc:398] Leaking SignalData structure 0x7b08001d9c40 after lost signal to thread 19752
I20260808 13:48:11.858516 18924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "43efdd0c2d224907a532c8f81d469c60" candidate_term: 8 candidate_status { last_received { term: 7 index: 32 } } ignore_live_leader: false dest_uuid: "c8034ed4c5804b538b25282ddf38e46e" is_pre_election: true
I20260808 13:48:11.871076 19595 leader_election.cc:304] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43efdd0c2d224907a532c8f81d469c60; no voters: b5e2d9219789424c809f622aff07d3f7, c8034ed4c5804b538b25282ddf38e46e
I20260808 13:48:11.860332 20249 consensus_queue.cc:1059] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260808 13:48:11.919296 20249 consensus_queue.cc:1243] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [NON_LEADER]: Peer bad61df9bf4649639959aea33b6d7ccd log is divergent from this leader: its last log entry 8.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260808 13:48:11.926959 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260808 13:48:11.927102 19791 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de942a19327e426b994b416686c1412a; no voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:48:11.928330 19791 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a; no voters: bad61df9bf4649639959aea33b6d7ccd
I20260808 13:48:11.929476 20249 raft_consensus.cc:2749] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260808 13:48:11.930838 20247 raft_consensus.cc:2804] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260808 13:48:11.931300 20247 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 6 FOLLOWER]: Starting leader election (detected failure of leader bad61df9bf4649639959aea33b6d7ccd)
I20260808 13:48:11.931609 20247 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 6 FOLLOWER]: Advancing to term 7
W20260808 13:48:11.935150 19643 debug-util.cc:398] Leaking SignalData structure 0x7b080004c460 after lost signal to thread 19892
I20260808 13:48:11.935349 19850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:11.936009 19847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
W20260808 13:48:11.936429 19643 debug-util.cc:398] Leaking SignalData structure 0x7b08001d7380 after lost signal to thread 20014
I20260808 13:48:11.936673 19848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
W20260808 13:48:11.937656 19643 debug-util.cc:398] Leaking SignalData structure 0x7b080019ef60 after lost signal to thread 20133
I20260808 13:48:11.938105 19848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:11.938508 20244 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260808 13:48:11.939400 19845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:11.941028 19845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:11.942515 19845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a"
I20260808 13:48:11.943951 19845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:11.945504 19845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:11.954691 20247 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:11.955974 19850 raft_consensus.cc:2393] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d00890937b5046758a2fb3cd9c79e8ad in current term 7: Already voted for candidate de942a19327e426b994b416686c1412a in this term.
I20260808 13:48:11.957612 20247 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 7 election: Requested vote from peers d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:11.983425 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd"
I20260808 13:48:11.994505 19916 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad; no voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a
I20260808 13:48:11.995978 19916 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad; no voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a
W20260808 13:48:12.006245 19790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260808 13:48:12.011729 20251 raft_consensus.cc:2749] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260808 13:48:12.012562 20251 raft_consensus.cc:2749] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260808 13:48:12.028172 19846 raft_consensus.cc:1240] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 7 FOLLOWER]: Rejecting Update request from peer bad61df9bf4649639959aea33b6d7ccd for earlier term 6. Current term is 7. Ops: []
I20260808 13:48:12.035081 20242 raft_consensus.cc:3060] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 7 FOLLOWER]: Advancing to term 8
I20260808 13:48:12.044265 20046 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd; no voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a
I20260808 13:48:12.045248 20240 raft_consensus.cc:2749] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260808 13:48:12.047907 19959 raft_consensus.cc:1275] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 8 FOLLOWER]: Refusing update from remote peer bad61df9bf4649639959aea33b6d7ccd: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260808 13:48:12.051501 19847 raft_consensus.cc:2468] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 8.
I20260808 13:48:12.052431 20248 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 13:48:12.053237 20248 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:12.053305 19960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad"
I20260808 13:48:12.059286 20240 consensus_queue.cc:1059] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260808 13:48:12.061067 20240 raft_consensus.cc:3055] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 6 LEADER]: Stepping down as leader of term 6
I20260808 13:48:12.061590 20240 raft_consensus.cc:740] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bad61df9bf4649639959aea33b6d7ccd, State: Running, Role: LEADER
I20260808 13:48:12.063313 20240 consensus_queue.cc:260] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:12.064445 20240 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 6 FOLLOWER]: Advancing to term 7
I20260808 13:48:12.064957 19791 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de942a19327e426b994b416686c1412a; no voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:48:12.072710 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:12.076454 19712 catalog_manager.cc:5697] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd reported cstate change: term changed from 7 to 8, leader changed from de942a19327e426b994b416686c1412a (127.16.219.193) to bad61df9bf4649639959aea33b6d7ccd (127.16.219.195). New cstate: current_term: 8 leader_uuid: "bad61df9bf4649639959aea33b6d7ccd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } health_report { overall_health: UNKNOWN } } }
I20260808 13:48:12.077630 19960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:12.084414 19960 raft_consensus.cc:2468] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de942a19327e426b994b416686c1412a in term 8.
I20260808 13:48:12.086117 19791 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a; no voters: bad61df9bf4649639959aea33b6d7ccd
I20260808 13:48:12.087061 20247 raft_consensus.cc:2749] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260808 13:48:12.084429 19846 raft_consensus.cc:1275] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 8 FOLLOWER]: Refusing update from remote peer bad61df9bf4649639959aea33b6d7ccd: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260808 13:48:12.089319 20247 raft_consensus.cc:2804] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260808 13:48:12.089192 20237 consensus_queue.cc:1048] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260808 13:48:12.092275 20247 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 13:48:12.092775 20247 raft_consensus.cc:3060] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 8 FOLLOWER]: Advancing to term 9
I20260808 13:48:12.099692 20248 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:12.111042 20237 consensus_queue.cc:1048] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260808 13:48:12.116875 20247 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:12.151903 19846 raft_consensus.cc:1240] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 9 FOLLOWER]: Rejecting Update request from peer bad61df9bf4649639959aea33b6d7ccd for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260808 13:48:12.157053 20247 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 9 election: Requested vote from peers bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:12.158162 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd"
I20260808 13:48:12.161680 19960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad"
I20260808 13:48:12.165922 19791 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de942a19327e426b994b416686c1412a; no voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:48:12.158331 20240 consensus_queue.cc:1059] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260808 13:48:12.177379 20247 raft_consensus.cc:2749] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260808 13:48:12.209728 20237 raft_consensus.cc:3055] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 8 LEADER]: Stepping down as leader of term 8
I20260808 13:48:12.210525 19846 raft_consensus.cc:1240] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 9 FOLLOWER]: Rejecting Update request from peer bad61df9bf4649639959aea33b6d7ccd for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260808 13:48:12.211030 20237 raft_consensus.cc:740] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bad61df9bf4649639959aea33b6d7ccd, State: Running, Role: LEADER
I20260808 13:48:12.213474 20240 consensus_queue.cc:1059] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260808 13:48:12.224326 20237 consensus_queue.cc:260] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:12.226287 20237 raft_consensus.cc:3060] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 8 FOLLOWER]: Advancing to term 9
I20260808 13:48:12.252831 20250 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bad61df9bf4649639959aea33b6d7ccd)
I20260808 13:48:12.253635 20250 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:12.257664 19846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:12.258644 19846 raft_consensus.cc:2393] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d00890937b5046758a2fb3cd9c79e8ad in current term 7: Already voted for candidate de942a19327e426b994b416686c1412a in this term.
I20260808 13:48:12.258677 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:12.259485 20102 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 7.
I20260808 13:48:12.260449 20250 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:12.261389 19916 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad; no voters: de942a19327e426b994b416686c1412a
I20260808 13:48:12.262336 20250 raft_consensus.cc:2804] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260808 13:48:12.262689 20250 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 6 FOLLOWER]: Starting leader election (detected failure of leader bad61df9bf4649639959aea33b6d7ccd)
I20260808 13:48:12.263074 20250 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 6 FOLLOWER]: Advancing to term 7
I20260808 13:48:12.271858 20250 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:12.274639 20250 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 7 election: Requested vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:12.275463 19846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a"
I20260808 13:48:12.276096 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd"
I20260808 13:48:12.276528 19846 raft_consensus.cc:2393] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d00890937b5046758a2fb3cd9c79e8ad in current term 7: Already voted for candidate de942a19327e426b994b416686c1412a in this term.
I20260808 13:48:12.284443 20102 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 7.
I20260808 13:48:12.285936 19916 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad; no voters: de942a19327e426b994b416686c1412a
I20260808 13:48:12.286928 20250 raft_consensus.cc:2804] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 7 FOLLOWER]: Leader election won for term 7
I20260808 13:48:12.288595 20250 raft_consensus.cc:697] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 7 LEADER]: Becoming Leader. State: Replica: d00890937b5046758a2fb3cd9c79e8ad, State: Running, Role: LEADER
I20260808 13:48:12.289827 20250 consensus_queue.cc:237] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:12.294535 20247 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 13:48:12.295490 20247 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:12.299734 19961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:12.304870 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:12.306452 19714 catalog_manager.cc:5697] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad reported cstate change: term changed from 6 to 7, leader changed from bad61df9bf4649639959aea33b6d7ccd (127.16.219.195) to d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194). New cstate: current_term: 7 leader_uuid: "d00890937b5046758a2fb3cd9c79e8ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } health_report { overall_health: UNKNOWN } } }
I20260808 13:48:12.307665 20102 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de942a19327e426b994b416686c1412a in term 7.
I20260808 13:48:12.309612 20247 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:12.314248 19791 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a; no voters: d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:48:12.315678 20247 raft_consensus.cc:2804] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260808 13:48:12.316524 20247 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 13:48:12.317050 20247 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 7 FOLLOWER]: Advancing to term 8
I20260808 13:48:12.331130 20247 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:12.339623 20247 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 8 election: Requested vote from peers d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:12.341122 19961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad"
I20260808 13:48:12.343477 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd"
I20260808 13:48:12.344276 20102 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 7 FOLLOWER]: Advancing to term 8
I20260808 13:48:12.355906 20250 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bad61df9bf4649639959aea33b6d7ccd)
I20260808 13:48:12.356626 20250 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:12.370822 19846 raft_consensus.cc:1240] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 8 FOLLOWER]: Rejecting Update request from peer d00890937b5046758a2fb3cd9c79e8ad for earlier term 7. Current term is 8. Ops: []
I20260808 13:48:12.372608 20174 consensus_queue.cc:1059] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 13:48:12.373557 20174 raft_consensus.cc:3055] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 7 LEADER]: Stepping down as leader of term 7
I20260808 13:48:12.373909 20174 raft_consensus.cc:740] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d00890937b5046758a2fb3cd9c79e8ad, State: Running, Role: LEADER
I20260808 13:48:12.374960 20174 consensus_queue.cc:260] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:12.376287 20174 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 7 FOLLOWER]: Advancing to term 8
I20260808 13:48:12.376384 20250 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613), de942a19327e426b994b416686c1412a (127.16.219.193:40615)
I20260808 13:48:12.379314 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:12.379887 19846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:12.380034 20103 raft_consensus.cc:2468] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 9.
I20260808 13:48:12.380786 19846 raft_consensus.cc:2393] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d00890937b5046758a2fb3cd9c79e8ad in current term 9: Already voted for candidate de942a19327e426b994b416686c1412a in this term.
I20260808 13:48:12.381553 19916 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad; no voters:
I20260808 13:48:12.383128 20252 raft_consensus.cc:2804] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260808 13:48:12.383555 20252 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 8 FOLLOWER]: Starting leader election (detected failure of leader bad61df9bf4649639959aea33b6d7ccd)
I20260808 13:48:12.383937 20252 raft_consensus.cc:3060] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 8 FOLLOWER]: Advancing to term 9
I20260808 13:48:12.385471 20102 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de942a19327e426b994b416686c1412a in term 8.
I20260808 13:48:12.389353 19791 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a; no voters: d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:48:12.402313 20247 raft_consensus.cc:2804] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 8 FOLLOWER]: Leader election won for term 8
I20260808 13:48:12.403528 20247 raft_consensus.cc:697] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 8 LEADER]: Becoming Leader. State: Replica: de942a19327e426b994b416686c1412a, State: Running, Role: LEADER
I20260808 13:48:12.407362 20252 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:12.411430 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd"
I20260808 13:48:12.416572 20242 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 13:48:12.417410 20242 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:12.421592 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:12.425004 19961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:12.423264 20242 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:12.425868 19961 raft_consensus.cc:2410] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de942a19327e426b994b416686c1412a for term 10 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260808 13:48:12.427187 19791 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de942a19327e426b994b416686c1412a; no voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:48:12.427888 20242 raft_consensus.cc:2749] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260808 13:48:12.429108 20247 consensus_queue.cc:237] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:12.431234 20103 raft_consensus.cc:2468] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 9.
I20260808 13:48:12.432737 19916 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad; no voters:
I20260808 13:48:12.434592 20174 raft_consensus.cc:2804] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 9 FOLLOWER]: Leader election won for term 9
I20260808 13:48:12.435117 20252 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 9 election: Requested vote from peers bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613), de942a19327e426b994b416686c1412a (127.16.219.193:40615)
I20260808 13:48:12.435479 19846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a"
I20260808 13:48:12.437440 19846 raft_consensus.cc:2393] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d00890937b5046758a2fb3cd9c79e8ad in current term 9: Already voted for candidate de942a19327e426b994b416686c1412a in this term.
I20260808 13:48:12.439437 20174 raft_consensus.cc:697] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 9 LEADER]: Becoming Leader. State: Replica: d00890937b5046758a2fb3cd9c79e8ad, State: Running, Role: LEADER
I20260808 13:48:12.440459 20174 consensus_queue.cc:237] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:12.447729 19714 catalog_manager.cc:5697] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a reported cstate change: term changed from 7 to 8, leader changed from d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194) to de942a19327e426b994b416686c1412a (127.16.219.193). New cstate: current_term: 8 leader_uuid: "de942a19327e426b994b416686c1412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } health_report { overall_health: UNKNOWN } } }
I20260808 13:48:12.462203 19712 catalog_manager.cc:5697] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad reported cstate change: term changed from 8 to 9, leader changed from bad61df9bf4649639959aea33b6d7ccd (127.16.219.195) to d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194). New cstate: current_term: 9 leader_uuid: "d00890937b5046758a2fb3cd9c79e8ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } health_report { overall_health: HEALTHY } } }
I20260808 13:48:12.529520 20103 raft_consensus.cc:1275] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 8 FOLLOWER]: Refusing update from remote peer de942a19327e426b994b416686c1412a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260808 13:48:12.531495 20247 consensus_queue.cc:1048] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 13:48:12.554813 19961 raft_consensus.cc:1275] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 8 FOLLOWER]: Refusing update from remote peer de942a19327e426b994b416686c1412a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260808 13:48:12.555220 19961 pending_rounds.cc:85] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad: Aborting all ops after (but not including) 7
I20260808 13:48:12.555444 19961 pending_rounds.cc:107] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260808 13:48:12.555688 19961 raft_consensus.cc:2889] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260808 13:48:12.557312 20248 consensus_queue.cc:1048] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 13:48:12.563831 20103 raft_consensus.cc:1275] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 9 FOLLOWER]: Refusing update from remote peer d00890937b5046758a2fb3cd9c79e8ad: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260808 13:48:12.565747 20174 consensus_queue.cc:1048] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260808 13:48:12.572538 19846 raft_consensus.cc:1275] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 9 FOLLOWER]: Refusing update from remote peer d00890937b5046758a2fb3cd9c79e8ad: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260808 13:48:12.578895 20174 consensus_queue.cc:1048] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260808 13:48:12.934046 19889 debug-util.cc:398] Leaking SignalData structure 0x7b0800163420 after lost signal to thread 17266
W20260808 13:48:12.935225 19889 debug-util.cc:398] Leaking SignalData structure 0x7b0800155d40 after lost signal to thread 18953
W20260808 13:48:12.936456 19889 debug-util.cc:398] Leaking SignalData structure 0x7b0800256340 after lost signal to thread 19647
W20260808 13:48:12.937595 19889 debug-util.cc:398] Leaking SignalData structure 0x7b0800242300 after lost signal to thread 19752
W20260808 13:48:12.938823 19889 debug-util.cc:398] Leaking SignalData structure 0x7b08001a5700 after lost signal to thread 19892
W20260808 13:48:12.939919 19889 debug-util.cc:398] Leaking SignalData structure 0x7b0800190f40 after lost signal to thread 20014
W20260808 13:48:12.940941 19889 debug-util.cc:398] Leaking SignalData structure 0x7b080015a420 after lost signal to thread 20133
I20260808 13:48:25.702170 20296 raft_consensus.cc:493] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5e2d9219789424c809f622aff07d3f7)
I20260808 13:48:25.703128 20296 raft_consensus.cc:515] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:48:25.707466 20296 leader_election.cc:290] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5e2d9219789424c809f622aff07d3f7 (127.16.219.254:37813), 43efdd0c2d224907a532c8f81d469c60 (127.16.219.252:36493)
I20260808 13:48:25.708694 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8034ed4c5804b538b25282ddf38e46e" candidate_term: 8 candidate_status { last_received { term: 7 index: 36 } } ignore_live_leader: false dest_uuid: "43efdd0c2d224907a532c8f81d469c60" is_pre_election: true
I20260808 13:48:25.783473 19723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8034ed4c5804b538b25282ddf38e46e" candidate_term: 8 candidate_status { last_received { term: 7 index: 36 } } ignore_live_leader: false dest_uuid: "b5e2d9219789424c809f622aff07d3f7" is_pre_election: true
I20260808 13:48:25.785444 18897 leader_election.cc:304] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8034ed4c5804b538b25282ddf38e46e; no voters: 43efdd0c2d224907a532c8f81d469c60, b5e2d9219789424c809f622aff07d3f7
I20260808 13:48:25.788208 20296 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260808 13:48:25.810505 20292 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader de942a19327e426b994b416686c1412a)
I20260808 13:48:25.811620 20292 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:25.817051 20292 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:25.817482 19846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:26.012506 20296 raft_consensus.cc:493] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5e2d9219789424c809f622aff07d3f7)
I20260808 13:48:26.013499 20296 raft_consensus.cc:515] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:48:26.017951 20296 leader_election.cc:290] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5e2d9219789424c809f622aff07d3f7 (127.16.219.254:37813), 43efdd0c2d224907a532c8f81d469c60 (127.16.219.252:36493)
I20260808 13:48:26.020018 19723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8034ed4c5804b538b25282ddf38e46e" candidate_term: 8 candidate_status { last_received { term: 7 index: 36 } } ignore_live_leader: false dest_uuid: "b5e2d9219789424c809f622aff07d3f7" is_pre_election: true
W20260808 13:48:26.023773 19916 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.219.195:44613 timed out after 0.206s (SENT) [suppressed 4 similar messages]
I20260808 13:48:26.027747 20297 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:26.028872 20297 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:26.034974 20297 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:26.043351 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:26.044118 20102 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 8.
I20260808 13:48:26.055431 20297 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:26.056440 20297 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:26.072208 19961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:26.073411 20298 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:26.074093 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:26.074522 19960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:26.076472 20298 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:26.077003 20103 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 8.
I20260808 13:48:26.082378 20300 raft_consensus.cc:493] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5e2d9219789424c809f622aff07d3f7)
I20260808 13:48:26.083200 20297 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:26.084146 20300 raft_consensus.cc:515] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:48:26.086647 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8034ed4c5804b538b25282ddf38e46e" candidate_term: 8 candidate_status { last_received { term: 7 index: 36 } } ignore_live_leader: false dest_uuid: "43efdd0c2d224907a532c8f81d469c60" is_pre_election: true
I20260808 13:48:26.087383 20299 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader de942a19327e426b994b416686c1412a)
I20260808 13:48:26.088970 18900 leader_election.cc:304] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8034ed4c5804b538b25282ddf38e46e; no voters: 43efdd0c2d224907a532c8f81d469c60, b5e2d9219789424c809f622aff07d3f7
I20260808 13:48:26.088979 20299 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:26.090355 20296 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260808 13:48:26.092049 19847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:26.090224 19916 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad; no voters: de942a19327e426b994b416686c1412a
I20260808 13:48:26.093061 19960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:26.095768 19723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "43efdd0c2d224907a532c8f81d469c60" candidate_term: 8 candidate_status { last_received { term: 7 index: 36 } } ignore_live_leader: false dest_uuid: "b5e2d9219789424c809f622aff07d3f7" is_pre_election: true
I20260808 13:48:26.096202 20288 raft_consensus.cc:2804] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260808 13:48:26.096702 20288 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 8 FOLLOWER]: Starting leader election (detected failure of leader de942a19327e426b994b416686c1412a)
I20260808 13:48:26.093937 19846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:26.097501 20046 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd; no voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a
I20260808 13:48:26.098102 18924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "43efdd0c2d224907a532c8f81d469c60" candidate_term: 8 candidate_status { last_received { term: 7 index: 36 } } ignore_live_leader: false dest_uuid: "c8034ed4c5804b538b25282ddf38e46e" is_pre_election: true
I20260808 13:48:26.097193 20288 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 8 FOLLOWER]: Advancing to term 9
I20260808 13:48:26.091709 20298 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:26.100883 20298 raft_consensus.cc:2749] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260808 13:48:26.100960 19595 leader_election.cc:304] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43efdd0c2d224907a532c8f81d469c60; no voters: b5e2d9219789424c809f622aff07d3f7, c8034ed4c5804b538b25282ddf38e46e
I20260808 13:48:26.112746 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:26.113950 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:26.114127 19791 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de942a19327e426b994b416686c1412a; no voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:48:26.114894 20297 raft_consensus.cc:2749] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260808 13:48:26.115651 19791 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de942a19327e426b994b416686c1412a; no voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:48:26.116698 20297 raft_consensus.cc:2749] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260808 13:48:26.107477 20300 leader_election.cc:290] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5e2d9219789424c809f622aff07d3f7 (127.16.219.254:37813), c8034ed4c5804b538b25282ddf38e46e (127.16.219.253:44897)
I20260808 13:48:26.118907 20300 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260808 13:48:26.119783 20299 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:26.122532 20288 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:26.122638 19960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:26.124332 20046 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd; no voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a
I20260808 13:48:26.124562 20288 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 9 election: Requested vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:26.125310 19846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a"
I20260808 13:48:26.125578 20299 raft_consensus.cc:2749] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260808 13:48:26.126986 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd"
I20260808 13:48:26.128186 19916 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad; no voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a
I20260808 13:48:26.128785 20288 raft_consensus.cc:2749] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260808 13:48:26.148023 19960 raft_consensus.cc:1240] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 9 FOLLOWER]: Rejecting Update request from peer de942a19327e426b994b416686c1412a for earlier term 8. Current term is 9. Ops: []
I20260808 13:48:26.149191 20297 consensus_queue.cc:1059] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260808 13:48:26.150138 20286 raft_consensus.cc:3055] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 8 LEADER]: Stepping down as leader of term 8
I20260808 13:48:26.150414 20286 raft_consensus.cc:740] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: de942a19327e426b994b416686c1412a, State: Running, Role: LEADER
I20260808 13:48:26.151100 20286 consensus_queue.cc:260] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:26.152009 20286 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 8 FOLLOWER]: Advancing to term 9
I20260808 13:48:26.310271 20286 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 13:48:26.310771 20286 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:26.313395 19960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:26.314129 20286 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:26.314154 19960 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de942a19327e426b994b416686c1412a in term 9.
I20260808 13:48:26.315258 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:26.315418 19791 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a; no voters:
I20260808 13:48:26.316123 20286 raft_consensus.cc:2804] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260808 13:48:26.316474 20286 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 13:48:26.316836 20286 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 9 FOLLOWER]: Advancing to term 10
I20260808 13:48:26.322551 20286 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:26.323920 20286 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 10 election: Requested vote from peers d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:26.324508 19960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad"
I20260808 13:48:26.324945 20103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd"
I20260808 13:48:26.325101 19960 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 9 FOLLOWER]: Advancing to term 10
I20260808 13:48:26.330417 19960 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de942a19327e426b994b416686c1412a in term 10.
I20260808 13:48:26.331439 19791 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a; no voters: bad61df9bf4649639959aea33b6d7ccd
I20260808 13:48:26.332219 20286 raft_consensus.cc:2804] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 10 FOLLOWER]: Leader election won for term 10
I20260808 13:48:26.332612 20286 raft_consensus.cc:697] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 10 LEADER]: Becoming Leader. State: Replica: de942a19327e426b994b416686c1412a, State: Running, Role: LEADER
I20260808 13:48:26.333366 20286 consensus_queue.cc:237] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:26.345273 20299 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader de942a19327e426b994b416686c1412a)
I20260808 13:48:26.345870 20299 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:26.350481 20299 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:26.354509 19960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:26.355336 19960 raft_consensus.cc:2368] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bad61df9bf4649639959aea33b6d7ccd for earlier term 9. Current term is 10.
I20260808 13:48:26.371246 20046 leader_election.cc:400] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 9 pre-election: Vote denied by peer d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283) with higher term. Message: Invalid argument: T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bad61df9bf4649639959aea33b6d7ccd for earlier term 9. Current term is 10.
I20260808 13:48:26.371678 20046 leader_election.cc:403] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260808 13:48:26.452082 20304 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 8 FOLLOWER]: Advancing to term 10
I20260808 13:48:26.513934 20304 raft_consensus.cc:2749] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283) with higher term. Message: Invalid argument: T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bad61df9bf4649639959aea33b6d7ccd for earlier term 9. Current term is 10.
I20260808 13:48:26.578598 20298 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:26.689324 20298 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
W20260808 13:48:26.689531 20046 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.219.193:40615, user_credentials={real_user=slave}} blocked reactor thread for 121524us
I20260808 13:48:26.687744 20299 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:26.692297 20298 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:26.692858 20299 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:26.694998 20299 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:26.733500 20309 raft_consensus.cc:493] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b5e2d9219789424c809f622aff07d3f7)
I20260808 13:48:26.735028 20309 raft_consensus.cc:515] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:48:26.739013 20309 leader_election.cc:290] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b5e2d9219789424c809f622aff07d3f7 (127.16.219.254:37813), 43efdd0c2d224907a532c8f81d469c60 (127.16.219.252:36493)
I20260808 13:48:26.795702 19846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:26.798451 19850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:26.798671 19847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:26.800210 19846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
W20260808 13:48:26.812660 19749 debug-util.cc:398] Leaking SignalData structure 0x7b0800136cc0 after lost signal to thread 17266
W20260808 13:48:26.813827 19749 debug-util.cc:398] Leaking SignalData structure 0x7b080002f980 after lost signal to thread 18953
I20260808 13:48:26.814113 19723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8034ed4c5804b538b25282ddf38e46e" candidate_term: 8 candidate_status { last_received { term: 7 index: 36 } } ignore_live_leader: false dest_uuid: "b5e2d9219789424c809f622aff07d3f7" is_pre_election: true
I20260808 13:48:26.814278 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8034ed4c5804b538b25282ddf38e46e" candidate_term: 8 candidate_status { last_received { term: 7 index: 36 } } ignore_live_leader: false dest_uuid: "43efdd0c2d224907a532c8f81d469c60" is_pre_election: true
I20260808 13:48:26.814845 19621 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8034ed4c5804b538b25282ddf38e46e in term 7.
W20260808 13:48:26.815027 19749 debug-util.cc:398] Leaking SignalData structure 0x7b0800208a40 after lost signal to thread 19647
I20260808 13:48:26.816035 18900 leader_election.cc:304] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43efdd0c2d224907a532c8f81d469c60, c8034ed4c5804b538b25282ddf38e46e; no voters:
I20260808 13:48:26.817404 20309 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260808 13:48:26.817684 19749 debug-util.cc:398] Leaking SignalData structure 0x7b08000a8f80 after lost signal to thread 19752
I20260808 13:48:26.817772 20309 raft_consensus.cc:493] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 7 FOLLOWER]: Starting leader election (detected failure of leader b5e2d9219789424c809f622aff07d3f7)
I20260808 13:48:26.818310 20309 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 7 FOLLOWER]: Advancing to term 8
W20260808 13:48:26.819089 19749 debug-util.cc:398] Leaking SignalData structure 0x7b08001e5c60 after lost signal to thread 19892
W20260808 13:48:26.820235 19749 debug-util.cc:398] Leaking SignalData structure 0x7b0800086160 after lost signal to thread 20014
W20260808 13:48:26.821379 19749 debug-util.cc:398] Leaking SignalData structure 0x7b08001f3b20 after lost signal to thread 20133
I20260808 13:48:26.826377 20309 raft_consensus.cc:515] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:48:26.829362 20309 leader_election.cc:290] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [CANDIDATE]: Term 8 election: Requested vote from peers b5e2d9219789424c809f622aff07d3f7 (127.16.219.254:37813), 43efdd0c2d224907a532c8f81d469c60 (127.16.219.252:36493)
I20260808 13:48:26.830886 19621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8034ed4c5804b538b25282ddf38e46e" candidate_term: 8 candidate_status { last_received { term: 7 index: 36 } } ignore_live_leader: false dest_uuid: "43efdd0c2d224907a532c8f81d469c60"
I20260808 13:48:26.831399 19621 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 7 FOLLOWER]: Advancing to term 8
I20260808 13:48:26.832710 19723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8034ed4c5804b538b25282ddf38e46e" candidate_term: 8 candidate_status { last_received { term: 7 index: 36 } } ignore_live_leader: false dest_uuid: "b5e2d9219789424c809f622aff07d3f7"
I20260808 13:48:26.841733 19621 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8034ed4c5804b538b25282ddf38e46e in term 8.
I20260808 13:48:26.842631 19620 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 8 FOLLOWER]: Rejecting Update request from peer b5e2d9219789424c809f622aff07d3f7 for earlier term 7. Current term is 8. Ops: []
I20260808 13:48:26.844532 19960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:26.846351 19961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:26.846514 20046 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd; no voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a
I20260808 13:48:26.848032 20299 raft_consensus.cc:2749] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260808 13:48:26.850314 18900 leader_election.cc:304] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43efdd0c2d224907a532c8f81d469c60, c8034ed4c5804b538b25282ddf38e46e; no voters: b5e2d9219789424c809f622aff07d3f7
I20260808 13:48:26.850237 20301 consensus_queue.cc:1059] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 }, Status: INVALID_TERM, Last received: 7.36, Next index: 37, Last known committed idx: 36, Time since last communication: 0.001s
I20260808 13:48:26.851645 20309 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 8 FOLLOWER]: Leader election won for term 8
I20260808 13:48:26.856518 20046 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd; no voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a
I20260808 13:48:26.856714 20301 raft_consensus.cc:3055] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 7 LEADER]: Stepping down as leader of term 7
I20260808 13:48:26.857136 20301 raft_consensus.cc:740] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b5e2d9219789424c809f622aff07d3f7, State: Running, Role: LEADER
I20260808 13:48:26.858353 20103 raft_consensus.cc:1275] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 10 FOLLOWER]: Refusing update from remote peer de942a19327e426b994b416686c1412a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260808 13:48:26.858132 20301 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 36, Committed index: 36, Last appended: 7.36, Last appended by leader: 36, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:48:26.858549 20299 raft_consensus.cc:2749] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260808 13:48:26.859824 20301 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 7 FOLLOWER]: Advancing to term 8
I20260808 13:48:26.863061 20286 consensus_queue.cc:1048] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260808 13:48:26.867827 20309 raft_consensus.cc:697] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 8 LEADER]: Becoming Leader. State: Replica: c8034ed4c5804b538b25282ddf38e46e, State: Running, Role: LEADER
I20260808 13:48:26.869001 20309 consensus_queue.cc:237] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 36, Committed index: 36, Last appended: 7.36, Last appended by leader: 36, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:48:26.954851 19621 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 8 FOLLOWER]: Refusing update from remote peer c8034ed4c5804b538b25282ddf38e46e: Log matching property violated. Preceding OpId in replica: term: 7 index: 36. Preceding OpId from leader: term: 8 index: 37. (index mismatch)
I20260808 13:48:26.959836 20309 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [LEADER]: Connected to new peer: Peer: permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 37, Last known committed idx: 36, Time since last communication: 0.001s
I20260808 13:48:27.328127 20304 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 13:48:27.329087 19961 raft_consensus.cc:1275] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 10 FOLLOWER]: Refusing update from remote peer de942a19327e426b994b416686c1412a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260808 13:48:27.328791 20304 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:27.330891 20303 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 13:48:27.331071 20304 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:27.331837 20304 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:27.333331 19961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:27.333194 20304 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:27.335389 20304 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:27.332556 19846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:27.336040 19847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:27.331579 20303 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:27.336643 19847 raft_consensus.cc:2468] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bad61df9bf4649639959aea33b6d7ccd in term 9.
I20260808 13:48:27.337148 19961 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bad61df9bf4649639959aea33b6d7ccd in term 10.
I20260808 13:48:27.337747 20304 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:27.338245 20046 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a; no voters:
I20260808 13:48:27.339732 20304 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:27.340500 19960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:27.351138 19847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:27.337543 20316 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:27.353399 20316 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:27.356477 20316 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:27.341025 20303 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:27.357007 20316 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:27.358917 19847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:27.359747 20304 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:27.360587 20304 raft_consensus.cc:2804] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260808 13:48:27.359779 19847 raft_consensus.cc:2468] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bad61df9bf4649639959aea33b6d7ccd in term 8.
I20260808 13:48:27.362319 20046 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a; no voters:
I20260808 13:48:27.358938 20317 raft_consensus.cc:493] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c8034ed4c5804b538b25282ddf38e46e)
I20260808 13:48:27.362950 19960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:27.363482 20316 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:27.366431 19960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:27.363360 20317 raft_consensus.cc:515] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:48:27.368055 20316 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:27.365682 20318 consensus_queue.cc:1048] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260808 13:48:27.363236 20304 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 9 FOLLOWER]: Starting leader election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:27.369539 20304 raft_consensus.cc:3060] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 9 FOLLOWER]: Advancing to term 10
I20260808 13:48:27.375830 19960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:27.376087 20298 raft_consensus.cc:2804] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260808 13:48:27.376662 20298 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 8 FOLLOWER]: Starting leader election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:27.377157 20298 raft_consensus.cc:3060] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 8 FOLLOWER]: Advancing to term 9
I20260808 13:48:27.388236 20321 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "c8034ed4c5804b538b25282ddf38e46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:48:27.389005 20321 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 13:48:27.393435 20099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:27.396224 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:27.396906 20104 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 10.
I20260808 13:48:27.398280 19916 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad; no voters: de942a19327e426b994b416686c1412a
I20260808 13:48:27.399205 20100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:27.399501 20303 raft_consensus.cc:2804] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260808 13:48:27.399441 20298 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:27.400125 20303 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 13:48:27.400655 20303 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 10 FOLLOWER]: Advancing to term 11
I20260808 13:48:27.404019 20313 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8034ed4c5804b538b25282ddf38e46e. Latest consensus state: current_term: 8 leader_uuid: "c8034ed4c5804b538b25282ddf38e46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:48:27.404910 20313 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 13:48:27.410832 20301 consensus_meta.cc:287] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7: Time spent flushing consensus metadata: real 0.551s user 0.036s sys 0.042s
I20260808 13:48:27.417119 20304 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:27.414273 20303 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:27.420831 20317 leader_election.cc:290] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5e2d9219789424c809f622aff07d3f7 (127.16.219.254:37813), c8034ed4c5804b538b25282ddf38e46e (127.16.219.253:44897)
I20260808 13:48:27.421227 19847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a"
I20260808 13:48:27.421850 19847 raft_consensus.cc:3060] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 9 FOLLOWER]: Advancing to term 10
I20260808 13:48:27.422926 20303 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 11 election: Requested vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:27.424271 20104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd"
I20260808 13:48:27.424599 19846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a"
I20260808 13:48:27.424793 20104 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 10 FOLLOWER]: Advancing to term 11
I20260808 13:48:27.425122 19959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad"
I20260808 13:48:27.425932 18924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "43efdd0c2d224907a532c8f81d469c60" candidate_term: 9 candidate_status { last_received { term: 8 index: 37 } } ignore_live_leader: false dest_uuid: "c8034ed4c5804b538b25282ddf38e46e" is_pre_election: true
I20260808 13:48:27.426822 20304 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 10 election: Requested vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:27.428500 20298 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 9 election: Requested vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:27.428696 19959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad"
I20260808 13:48:27.430967 20100 raft_consensus.cc:2393] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de942a19327e426b994b416686c1412a in current term 9: Already voted for candidate bad61df9bf4649639959aea33b6d7ccd in this term.
I20260808 13:48:27.430915 20311 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8034ed4c5804b538b25282ddf38e46e. Latest consensus state: current_term: 8 leader_uuid: "c8034ed4c5804b538b25282ddf38e46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:48:27.432310 20311 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: This master's current role is: LEADER
I20260808 13:48:27.436013 19846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a"
I20260808 13:48:27.436704 19846 raft_consensus.cc:3060] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 8 FOLLOWER]: Advancing to term 9
I20260808 13:48:27.428784 19724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "43efdd0c2d224907a532c8f81d469c60" candidate_term: 9 candidate_status { last_received { term: 8 index: 37 } } ignore_live_leader: false dest_uuid: "b5e2d9219789424c809f622aff07d3f7" is_pre_election: true
I20260808 13:48:27.439397 20099 raft_consensus.cc:2393] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de942a19327e426b994b416686c1412a in current term 10: Already voted for candidate bad61df9bf4649639959aea33b6d7ccd in this term.
I20260808 13:48:27.439736 19594 leader_election.cc:304] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43efdd0c2d224907a532c8f81d469c60; no voters: b5e2d9219789424c809f622aff07d3f7, c8034ed4c5804b538b25282ddf38e46e
I20260808 13:48:27.439937 19960 raft_consensus.cc:1240] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 11 FOLLOWER]: Rejecting Update request from peer de942a19327e426b994b416686c1412a for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260808 13:48:27.440876 20317 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260808 13:48:27.440927 20103 raft_consensus.cc:1240] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 10 FOLLOWER]: Rejecting Update request from peer d00890937b5046758a2fb3cd9c79e8ad for earlier term 9. Current term is 10. Ops: []
I20260808 13:48:27.442734 19791 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de942a19327e426b994b416686c1412a; no voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:48:27.444871 20046 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad; no voters: de942a19327e426b994b416686c1412a
I20260808 13:48:27.448021 19723 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 8 FOLLOWER]: Refusing update from remote peer c8034ed4c5804b538b25282ddf38e46e: Log matching property violated. Preceding OpId in replica: term: 7 index: 36. Preceding OpId from leader: term: 8 index: 37. (index mismatch)
I20260808 13:48:27.453688 20104 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 11.
I20260808 13:48:27.462368 19916 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad; no voters: de942a19327e426b994b416686c1412a
I20260808 13:48:27.462734 19846 raft_consensus.cc:2468] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bad61df9bf4649639959aea33b6d7ccd in term 9.
I20260808 13:48:27.464779 20310 raft_consensus.cc:493] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 13:48:27.465260 20310 raft_consensus.cc:515] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:48:27.465718 20303 raft_consensus.cc:2804] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 11 FOLLOWER]: Leader election won for term 11
I20260808 13:48:27.466363 20101 raft_consensus.cc:1240] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 11 FOLLOWER]: Rejecting Update request from peer de942a19327e426b994b416686c1412a for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260808 13:48:27.467478 19845 raft_consensus.cc:1240] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 9 FOLLOWER]: Rejecting Update request from peer d00890937b5046758a2fb3cd9c79e8ad for earlier term 8. Current term is 9. Ops: []
I20260808 13:48:27.462270 20318 consensus_queue.cc:1059] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260808 13:48:27.469058 20316 raft_consensus.cc:3055] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 10 LEADER]: Stepping down as leader of term 10
I20260808 13:48:27.469589 20316 raft_consensus.cc:740] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: de942a19327e426b994b416686c1412a, State: Running, Role: LEADER
I20260808 13:48:27.462414 20309 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 37, Last known committed idx: 36, Time since last communication: 0.012s
I20260808 13:48:27.473487 20316 consensus_queue.cc:260] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:27.475881 20309 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 8 leader_uuid: "c8034ed4c5804b538b25282ddf38e46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:48:27.476727 20309 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: This master's current role is: LEADER
I20260808 13:48:27.476867 20316 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 10 FOLLOWER]: Advancing to term 11
I20260808 13:48:27.462196 20292 consensus_queue.cc:1059] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260808 13:48:27.479557 20288 raft_consensus.cc:3055] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 9 LEADER]: Stepping down as leader of term 9
I20260808 13:48:27.480018 20288 raft_consensus.cc:740] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d00890937b5046758a2fb3cd9c79e8ad, State: Running, Role: LEADER
I20260808 13:48:27.484516 18924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e2d9219789424c809f622aff07d3f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 36 } } ignore_live_leader: false dest_uuid: "c8034ed4c5804b538b25282ddf38e46e" is_pre_election: true
I20260808 13:48:27.484889 20310 leader_election.cc:290] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c8034ed4c5804b538b25282ddf38e46e (127.16.219.253:44897), 43efdd0c2d224907a532c8f81d469c60 (127.16.219.252:36493)
I20260808 13:48:27.470331 20298 raft_consensus.cc:2764] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260808 13:48:27.481230 20288 consensus_queue.cc:260] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:27.491281 20046 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a; no voters: d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:48:27.491655 20102 raft_consensus.cc:1240] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 9 FOLLOWER]: Rejecting Update request from peer d00890937b5046758a2fb3cd9c79e8ad for earlier term 8. Current term is 9. Ops: []
I20260808 13:48:27.466758 20303 raft_consensus.cc:697] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 11 LEADER]: Becoming Leader. State: Replica: d00890937b5046758a2fb3cd9c79e8ad, State: Running, Role: LEADER
I20260808 13:48:27.496812 20288 raft_consensus.cc:3060] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 9 FOLLOWER]: Advancing to term 10
I20260808 13:48:27.498049 20304 raft_consensus.cc:2804] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 9 FOLLOWER]: Leader election won for term 9
I20260808 13:48:27.498314 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e2d9219789424c809f622aff07d3f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 36 } } ignore_live_leader: false dest_uuid: "43efdd0c2d224907a532c8f81d469c60" is_pre_election: true
I20260808 13:48:27.502002 20304 raft_consensus.cc:697] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 9 LEADER]: Becoming Leader. State: Replica: bad61df9bf4649639959aea33b6d7ccd, State: Running, Role: LEADER
I20260808 13:48:27.498664 19791 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de942a19327e426b994b416686c1412a; no voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:48:27.503264 20318 raft_consensus.cc:2749] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260808 13:48:27.502972 20304 consensus_queue.cc:237] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:27.503456 19700 leader_election.cc:304] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5e2d9219789424c809f622aff07d3f7; no voters: 43efdd0c2d224907a532c8f81d469c60, c8034ed4c5804b538b25282ddf38e46e
I20260808 13:48:27.463979 19847 raft_consensus.cc:2468] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bad61df9bf4649639959aea33b6d7ccd in term 10.
I20260808 13:48:27.510854 20286 raft_consensus.cc:2749] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260808 13:48:27.495740 20292 consensus_queue.cc:1059] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260808 13:48:27.512588 20046 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a; no voters: d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:48:27.518584 19850 raft_consensus.cc:1240] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 10 FOLLOWER]: Rejecting Update request from peer d00890937b5046758a2fb3cd9c79e8ad for earlier term 9. Current term is 10. Ops: []
I20260808 13:48:27.519109 20298 raft_consensus.cc:2804] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 10 FOLLOWER]: Leader election won for term 10
I20260808 13:48:27.520993 20298 raft_consensus.cc:697] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 10 LEADER]: Becoming Leader. State: Replica: bad61df9bf4649639959aea33b6d7ccd, State: Running, Role: LEADER
I20260808 13:48:27.522286 20298 consensus_queue.cc:237] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:27.532490 20303 consensus_queue.cc:237] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
W20260808 13:48:27.537839 19918 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260808 13:48:27.544205 20288 raft_consensus.cc:3055] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 8 LEADER]: Stepping down as leader of term 8
I20260808 13:48:27.544601 20288 raft_consensus.cc:740] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d00890937b5046758a2fb3cd9c79e8ad, State: Running, Role: LEADER
I20260808 13:48:27.545540 20288 consensus_queue.cc:260] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:27.547034 20292 consensus_queue.cc:1059] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260808 13:48:27.561671 20288 raft_consensus.cc:3060] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 8 FOLLOWER]: Advancing to term 9
W20260808 13:48:27.573814 19916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260808 13:48:27.601466 20301 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260808 13:48:27.605475 20310 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8034ed4c5804b538b25282ddf38e46e. Latest consensus state: current_term: 8 leader_uuid: "c8034ed4c5804b538b25282ddf38e46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:48:27.605511 20332 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "c8034ed4c5804b538b25282ddf38e46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:48:27.606560 20310 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 13:48:27.606694 20332 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 13:48:27.617758 19850 raft_consensus.cc:1275] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 10 FOLLOWER]: Refusing update from remote peer bad61df9bf4649639959aea33b6d7ccd: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260808 13:48:27.619166 19960 raft_consensus.cc:1275] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 10 FOLLOWER]: Refusing update from remote peer bad61df9bf4649639959aea33b6d7ccd: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260808 13:48:27.619709 20298 consensus_queue.cc:1048] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260808 13:48:27.621292 20304 consensus_queue.cc:1048] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260808 13:48:27.629539 19961 raft_consensus.cc:1275] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 9 FOLLOWER]: Refusing update from remote peer bad61df9bf4649639959aea33b6d7ccd: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260808 13:48:27.632845 19847 raft_consensus.cc:1275] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 9 FOLLOWER]: Refusing update from remote peer bad61df9bf4649639959aea33b6d7ccd: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260808 13:48:27.631502 20304 consensus_queue.cc:1048] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260808 13:48:27.635716 20298 consensus_queue.cc:1048] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260808 13:48:27.644428 20316 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 13:48:27.645150 20316 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:27.650681 19959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:27.657573 20100 raft_consensus.cc:1275] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 11 FOLLOWER]: Refusing update from remote peer d00890937b5046758a2fb3cd9c79e8ad: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260808 13:48:27.658180 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:27.658897 20102 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de942a19327e426b994b416686c1412a in term 11.
I20260808 13:48:27.660182 19791 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a; no voters: d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:48:27.660946 20286 raft_consensus.cc:2804] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260808 13:48:27.661578 20286 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 13:48:27.661981 20286 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 11 FOLLOWER]: Advancing to term 12
I20260808 13:48:27.661012 20316 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:27.669380 20292 consensus_queue.cc:1048] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260808 13:48:27.691548 20286 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:27.695482 20311 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 8 leader_uuid: "c8034ed4c5804b538b25282ddf38e46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:48:27.697063 20311 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: This master's current role is: LEADER
I20260808 13:48:27.700479 19847 raft_consensus.cc:1240] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 12 FOLLOWER]: Rejecting Update request from peer d00890937b5046758a2fb3cd9c79e8ad for earlier term 11. Current term is 12. Ops: []
I20260808 13:48:27.710503 20292 consensus_queue.cc:1059] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260808 13:48:27.711741 20292 consensus_queue.cc:1243] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Peer de942a19327e426b994b416686c1412a log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260808 13:48:27.711810 20286 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 12 election: Requested vote from peers d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:27.717706 20303 raft_consensus.cc:3055] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 11 LEADER]: Stepping down as leader of term 11
I20260808 13:48:27.721158 20303 raft_consensus.cc:740] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d00890937b5046758a2fb3cd9c79e8ad, State: Running, Role: LEADER
I20260808 13:48:27.722306 20100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd"
I20260808 13:48:27.724115 19959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad"
I20260808 13:48:27.723681 20303 consensus_queue.cc:260] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:27.725649 20303 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 11 FOLLOWER]: Advancing to term 12
I20260808 13:48:27.752936 19959 raft_consensus.cc:2410] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate de942a19327e426b994b416686c1412a for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260808 13:48:27.756107 19791 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de942a19327e426b994b416686c1412a; no voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:48:27.757642 20286 raft_consensus.cc:2749] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260808 13:48:27.877534 20010 debug-util.cc:398] Leaking SignalData structure 0x7b08001c0260 after lost signal to thread 17266
W20260808 13:48:27.878829 20010 debug-util.cc:398] Leaking SignalData structure 0x7b08001c4b40 after lost signal to thread 18953
W20260808 13:48:27.880152 20010 debug-util.cc:398] Leaking SignalData structure 0x7b08000f9640 after lost signal to thread 19647
W20260808 13:48:27.881423 20010 debug-util.cc:398] Leaking SignalData structure 0x7b0800207660 after lost signal to thread 19752
W20260808 13:48:27.883076 20010 debug-util.cc:398] Leaking SignalData structure 0x7b0800050d40 after lost signal to thread 19892
W20260808 13:48:27.884850 20010 debug-util.cc:398] Leaking SignalData structure 0x7b080023c500 after lost signal to thread 20014
I20260808 13:48:27.885869 20303 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 13:48:27.887929 20303 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:27.889349 20298 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:27.889876 20298 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:27.892082 20298 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:27.893870 19850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:27.894680 19850 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 12.
I20260808 13:48:27.895417 19960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:27.895911 19916 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a; no voters:
I20260808 13:48:27.896046 19960 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bad61df9bf4649639959aea33b6d7ccd in term 12.
I20260808 13:48:27.893854 19847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:27.897030 19847 raft_consensus.cc:2393] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bad61df9bf4649639959aea33b6d7ccd in current term 12: Already voted for candidate de942a19327e426b994b416686c1412a in this term.
I20260808 13:48:27.897315 20046 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad; no voters:
I20260808 13:48:27.897532 20292 raft_consensus.cc:2804] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260808 13:48:27.897962 20292 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 13:48:27.898357 20292 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 12 FOLLOWER]: Advancing to term 13
I20260808 13:48:27.898622 20298 raft_consensus.cc:2804] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260808 13:48:27.898998 20298 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 11 FOLLOWER]: Starting leader election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:27.899078 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:27.899432 20298 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 11 FOLLOWER]: Advancing to term 12
I20260808 13:48:27.899742 20303 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
W20260808 13:48:27.902397 20010 debug-util.cc:398] Leaking SignalData structure 0x7b08001b8e40 after lost signal to thread 20133
I20260808 13:48:27.906339 20298 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:27.907357 20102 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 12.
I20260808 13:48:27.909814 20298 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 12 election: Requested vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:27.909677 19847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a"
I20260808 13:48:27.910809 19960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad"
I20260808 13:48:27.911669 19847 raft_consensus.cc:2393] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bad61df9bf4649639959aea33b6d7ccd in current term 12: Already voted for candidate de942a19327e426b994b416686c1412a in this term.
I20260808 13:48:27.914362 20292 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:27.915589 19960 raft_consensus.cc:2368] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bad61df9bf4649639959aea33b6d7ccd for earlier term 12. Current term is 13.
I20260808 13:48:27.917064 19847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a"
I20260808 13:48:27.917620 20046 leader_election.cc:400] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 12 election: Vote denied by peer d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283) with higher term. Message: Invalid argument: T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bad61df9bf4649639959aea33b6d7ccd for earlier term 12. Current term is 13.
I20260808 13:48:27.917970 20046 leader_election.cc:403] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260808 13:48:27.918542 20292 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 13 election: Requested vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:27.917640 19847 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 12 FOLLOWER]: Advancing to term 13
I20260808 13:48:27.919001 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd"
I20260808 13:48:27.919196 20298 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 12 FOLLOWER]: Advancing to term 13
I20260808 13:48:27.926558 20298 raft_consensus.cc:2749] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283) with higher term. Message: Invalid argument: T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bad61df9bf4649639959aea33b6d7ccd for earlier term 12. Current term is 13.
I20260808 13:48:27.929286 19847 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 13.
I20260808 13:48:27.930378 19916 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a; no voters:
I20260808 13:48:27.931139 20292 raft_consensus.cc:2804] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 13 FOLLOWER]: Leader election won for term 13
I20260808 13:48:27.931730 20292 raft_consensus.cc:697] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 13 LEADER]: Becoming Leader. State: Replica: d00890937b5046758a2fb3cd9c79e8ad, State: Running, Role: LEADER
I20260808 13:48:27.932622 20292 consensus_queue.cc:237] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:27.933254 20102 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 13.
I20260808 13:48:28.022774 20102 raft_consensus.cc:1275] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 13 FOLLOWER]: Refusing update from remote peer d00890937b5046758a2fb3cd9c79e8ad: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260808 13:48:28.024274 20292 consensus_queue.cc:1048] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260808 13:48:28.036320 19847 raft_consensus.cc:1275] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 13 FOLLOWER]: Refusing update from remote peer d00890937b5046758a2fb3cd9c79e8ad: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260808 13:48:28.042783 20288 consensus_queue.cc:1048] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260808 13:48:28.043418 20288 consensus_queue.cc:1243] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Peer de942a19327e426b994b416686c1412a log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260808 13:48:28.048255 19847 pending_rounds.cc:85] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a: Aborting all ops after (but not including) 8
I20260808 13:48:28.048568 19847 pending_rounds.cc:107] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260808 13:48:28.048842 19847 raft_consensus.cc:2889] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260808 13:48:30.936503 20349 raft_consensus.cc:493] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c8034ed4c5804b538b25282ddf38e46e)
I20260808 13:48:30.937631 20349 raft_consensus.cc:515] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:48:30.946010 20349 leader_election.cc:290] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c8034ed4c5804b538b25282ddf38e46e (127.16.219.253:44897), 43efdd0c2d224907a532c8f81d469c60 (127.16.219.252:36493)
I20260808 13:48:31.012004 20350 raft_consensus.cc:493] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c8034ed4c5804b538b25282ddf38e46e)
I20260808 13:48:31.012974 20350 raft_consensus.cc:515] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } }
I20260808 13:48:31.019610 20350 leader_election.cc:290] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b5e2d9219789424c809f622aff07d3f7 (127.16.219.254:37813), c8034ed4c5804b538b25282ddf38e46e (127.16.219.253:44897)
I20260808 13:48:31.020467 19723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "43efdd0c2d224907a532c8f81d469c60" candidate_term: 9 candidate_status { last_received { term: 8 index: 37 } } ignore_live_leader: false dest_uuid: "b5e2d9219789424c809f622aff07d3f7" is_pre_election: true
I20260808 13:48:31.031288 18925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "43efdd0c2d224907a532c8f81d469c60" candidate_term: 9 candidate_status { last_received { term: 8 index: 37 } } ignore_live_leader: false dest_uuid: "c8034ed4c5804b538b25282ddf38e46e" is_pre_election: true
I20260808 13:48:31.034399 19595 leader_election.cc:304] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43efdd0c2d224907a532c8f81d469c60; no voters: b5e2d9219789424c809f622aff07d3f7, c8034ed4c5804b538b25282ddf38e46e
I20260808 13:48:31.035382 20350 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260808 13:48:31.069563 19620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e2d9219789424c809f622aff07d3f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 37 } } ignore_live_leader: false dest_uuid: "43efdd0c2d224907a532c8f81d469c60" is_pre_election: true
I20260808 13:48:31.081717 18924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e2d9219789424c809f622aff07d3f7" candidate_term: 9 candidate_status { last_received { term: 8 index: 37 } } ignore_live_leader: false dest_uuid: "c8034ed4c5804b538b25282ddf38e46e" is_pre_election: true
I20260808 13:48:31.083662 19698 leader_election.cc:304] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5e2d9219789424c809f622aff07d3f7; no voters: 43efdd0c2d224907a532c8f81d469c60, c8034ed4c5804b538b25282ddf38e46e
I20260808 13:48:31.084524 20349 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260808 13:48:31.096346 20292 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bad61df9bf4649639959aea33b6d7ccd)
I20260808 13:48:31.097025 20292 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:31.100538 20347 raft_consensus.cc:493] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bad61df9bf4649639959aea33b6d7ccd)
I20260808 13:48:31.101594 20292 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613), de942a19327e426b994b416686c1412a (127.16.219.193:40615)
I20260808 13:48:31.101287 20347 raft_consensus.cc:515] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:31.103763 20347 leader_election.cc:290] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
W20260808 13:48:31.125604 19793 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.16.219.252:36493, user_credentials={real_user=slave}} blocked reactor thread for 167589us
I20260808 13:48:31.129405 20304 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:31.130227 20304 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:31.132630 20304 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:31.139413 19850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:31.139534 19960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:31.140692 19850 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bad61df9bf4649639959aea33b6d7ccd in term 13.
I20260808 13:48:31.145099 20356 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bad61df9bf4649639959aea33b6d7ccd)
I20260808 13:48:31.151574 20046 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a; no voters: d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:48:31.145735 20356 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:31.153949 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:31.155630 20100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:31.156549 20298 raft_consensus.cc:2804] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260808 13:48:31.157034 20298 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 13 FOLLOWER]: Starting leader election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:31.157477 20298 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 13 FOLLOWER]: Advancing to term 14
I20260808 13:48:31.158025 20100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:31.166160 19847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:31.166965 19847 raft_consensus.cc:2468] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 10.
I20260808 13:48:31.167512 20356 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:31.171170 19960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:31.173229 19846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee2d1274d4841acb80fab840190d1f6" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:31.175421 19791 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de942a19327e426b994b416686c1412a; no voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad
I20260808 13:48:31.176693 20356 raft_consensus.cc:2749] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260808 13:48:31.177115 20298 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:31.179075 20298 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 14 election: Requested vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:31.179209 20101 raft_consensus.cc:1240] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 14 FOLLOWER]: Rejecting Update request from peer d00890937b5046758a2fb3cd9c79e8ad for earlier term 13. Current term is 14. Ops: []
I20260808 13:48:31.180238 19916 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a; no voters: bad61df9bf4649639959aea33b6d7ccd
I20260808 13:48:31.180621 19960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad"
I20260808 13:48:31.184640 20347 raft_consensus.cc:2804] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260808 13:48:31.185010 20347 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 10 FOLLOWER]: Starting leader election (detected failure of leader bad61df9bf4649639959aea33b6d7ccd)
I20260808 13:48:31.185401 20347 raft_consensus.cc:3060] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 10 FOLLOWER]: Advancing to term 11
I20260808 13:48:31.185315 19850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a"
I20260808 13:48:31.190738 20292 consensus_queue.cc:1059] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260808 13:48:31.197691 20046 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd; no voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a
I20260808 13:48:31.200964 20347 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:31.201591 20348 raft_consensus.cc:2749] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260808 13:48:31.202558 19960 raft_consensus.cc:1240] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 11 FOLLOWER]: Rejecting Update request from peer bad61df9bf4649639959aea33b6d7ccd for earlier term 10. Current term is 11. Ops: []
I20260808 13:48:31.205832 20298 consensus_queue.cc:1059] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 }, Status: INVALID_TERM, Last received: 10.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260808 13:48:31.206641 20347 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 11 election: Requested vote from peers bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613), de942a19327e426b994b416686c1412a (127.16.219.193:40615)
I20260808 13:48:31.207387 20348 raft_consensus.cc:3055] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 10 LEADER]: Stepping down as leader of term 10
I20260808 13:48:31.207965 20348 raft_consensus.cc:740] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bad61df9bf4649639959aea33b6d7ccd, State: Running, Role: LEADER
I20260808 13:48:31.208544 19916 leader_election.cc:304] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad; no voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a
I20260808 13:48:31.210443 20358 raft_consensus.cc:2749] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260808 13:48:31.210616 20348 consensus_queue.cc:260] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:31.212998 20101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd"
I20260808 13:48:31.213181 20348 raft_consensus.cc:3060] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 10 FOLLOWER]: Advancing to term 11
I20260808 13:48:31.215723 20292 raft_consensus.cc:3055] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 13 LEADER]: Stepping down as leader of term 13
I20260808 13:48:31.216126 20292 raft_consensus.cc:740] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d00890937b5046758a2fb3cd9c79e8ad, State: Running, Role: LEADER
I20260808 13:48:31.217248 20292 consensus_queue.cc:260] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:31.218190 19850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb6c443eab04445a885a5150910d735" candidate_uuid: "d00890937b5046758a2fb3cd9c79e8ad" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a"
I20260808 13:48:31.218904 20292 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 13 FOLLOWER]: Advancing to term 14
I20260808 13:48:31.235486 20101 raft_consensus.cc:2468] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d00890937b5046758a2fb3cd9c79e8ad in term 11.
I20260808 13:48:31.237908 19916 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, d00890937b5046758a2fb3cd9c79e8ad; no voters: de942a19327e426b994b416686c1412a
I20260808 13:48:31.238898 20292 raft_consensus.cc:2804] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 11 FOLLOWER]: Leader election won for term 11
I20260808 13:48:31.239481 20292 raft_consensus.cc:697] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 11 LEADER]: Becoming Leader. State: Replica: d00890937b5046758a2fb3cd9c79e8ad, State: Running, Role: LEADER
I20260808 13:48:31.240554 20292 consensus_queue.cc:237] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:31.338186 19850 raft_consensus.cc:3060] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 10 FOLLOWER]: Advancing to term 11
I20260808 13:48:31.349805 19850 raft_consensus.cc:1275] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 11 FOLLOWER]: Refusing update from remote peer d00890937b5046758a2fb3cd9c79e8ad: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 11 index: 13. (index mismatch)
I20260808 13:48:31.353370 20292 consensus_queue.cc:1048] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260808 13:48:31.362332 20101 raft_consensus.cc:1275] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 11 FOLLOWER]: Refusing update from remote peer d00890937b5046758a2fb3cd9c79e8ad: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 11 index: 13. (index mismatch)
I20260808 13:48:31.364375 20347 consensus_queue.cc:1048] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260808 13:48:31.370437 20356 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:31.371022 20356 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:31.374894 19960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:31.375547 19960 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de942a19327e426b994b416686c1412a in term 14.
I20260808 13:48:31.377385 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd" is_pre_election: true
I20260808 13:48:31.378172 20102 raft_consensus.cc:2393] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de942a19327e426b994b416686c1412a in current term 14: Already voted for candidate bad61df9bf4649639959aea33b6d7ccd in this term.
I20260808 13:48:31.379472 20356 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:31.380261 19791 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a; no voters: bad61df9bf4649639959aea33b6d7ccd
I20260808 13:48:31.381367 20356 raft_consensus.cc:2804] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260808 13:48:31.381778 20356 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 13 FOLLOWER]: Starting leader election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:31.382385 20356 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 13 FOLLOWER]: Advancing to term 14
I20260808 13:48:31.395272 20356 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:31.399322 20100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bad61df9bf4649639959aea33b6d7ccd"
I20260808 13:48:31.400204 20100 raft_consensus.cc:2393] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate de942a19327e426b994b416686c1412a in current term 14: Already voted for candidate bad61df9bf4649639959aea33b6d7ccd in this term.
I20260808 13:48:31.400254 19960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "de942a19327e426b994b416686c1412a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad"
I20260808 13:48:31.401881 20356 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 14 election: Requested vote from peers d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283), bad61df9bf4649639959aea33b6d7ccd (127.16.219.195:44613)
I20260808 13:48:31.405823 20298 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 13:48:31.406358 20298 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:31.411640 20298 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:31.413702 19850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a" is_pre_election: true
I20260808 13:48:31.414511 19850 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bad61df9bf4649639959aea33b6d7ccd in term 14.
I20260808 13:48:31.416076 20046 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a; no voters:
I20260808 13:48:31.416646 19959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad" is_pre_election: true
I20260808 13:48:31.418630 20298 raft_consensus.cc:2804] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260808 13:48:31.418972 20298 raft_consensus.cc:493] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 13:48:31.419237 20298 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 14 FOLLOWER]: Advancing to term 15
I20260808 13:48:31.425791 19960 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de942a19327e426b994b416686c1412a in term 14.
I20260808 13:48:31.426657 20298 raft_consensus.cc:515] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:31.429353 19850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "de942a19327e426b994b416686c1412a"
I20260808 13:48:31.429996 19850 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 14 FOLLOWER]: Advancing to term 15
I20260808 13:48:31.435670 19791 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a; no voters: bad61df9bf4649639959aea33b6d7ccd
I20260808 13:48:31.441958 20298 leader_election.cc:290] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 15 election: Requested vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
I20260808 13:48:31.443105 19960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5931425868b4b63b910f7ceff47dc01" candidate_uuid: "bad61df9bf4649639959aea33b6d7ccd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d00890937b5046758a2fb3cd9c79e8ad"
I20260808 13:48:31.443600 19960 raft_consensus.cc:3060] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 14 FOLLOWER]: Advancing to term 15
I20260808 13:48:31.444595 19850 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bad61df9bf4649639959aea33b6d7ccd in term 15.
I20260808 13:48:31.445408 20356 raft_consensus.cc:2764] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260808 13:48:31.446570 20046 leader_election.cc:304] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd, de942a19327e426b994b416686c1412a; no voters:
I20260808 13:48:31.447757 20298 raft_consensus.cc:2804] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 15 FOLLOWER]: Leader election won for term 15
I20260808 13:48:31.448303 20298 raft_consensus.cc:697] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 15 LEADER]: Becoming Leader. State: Replica: bad61df9bf4649639959aea33b6d7ccd, State: Running, Role: LEADER
I20260808 13:48:31.449273 20298 consensus_queue.cc:237] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } }
I20260808 13:48:31.450263 19960 raft_consensus.cc:2468] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bad61df9bf4649639959aea33b6d7ccd in term 15.
I20260808 13:48:31.528512 19960 raft_consensus.cc:1275] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 15 FOLLOWER]: Refusing update from remote peer bad61df9bf4649639959aea33b6d7ccd: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260808 13:48:31.529783 20298 consensus_queue.cc:1048] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260808 13:48:31.552086 19850 raft_consensus.cc:1275] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 15 FOLLOWER]: Refusing update from remote peer bad61df9bf4649639959aea33b6d7ccd: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260808 13:48:31.554526 20298 consensus_queue.cc:1048] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [LEADER]: Connected to new peer: Peer: permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260808 13:48:31.972477 19749 debug-util.cc:398] Leaking SignalData structure 0x7b08001f38e0 after lost signal to thread 17266
W20260808 13:48:31.973779 19749 debug-util.cc:398] Leaking SignalData structure 0x7b080003f8a0 after lost signal to thread 18953
W20260808 13:48:31.975037 19749 debug-util.cc:398] Leaking SignalData structure 0x7b08001d35e0 after lost signal to thread 19647
W20260808 13:48:31.976191 19749 debug-util.cc:398] Leaking SignalData structure 0x7b08001bfa80 after lost signal to thread 19752
W20260808 13:48:31.979080 19749 debug-util.cc:398] Leaking SignalData structure 0x7b08001a67c0 after lost signal to thread 19892
W20260808 13:48:31.980191 19749 debug-util.cc:398] Leaking SignalData structure 0x7b08001a2d80 after lost signal to thread 20014
W20260808 13:48:31.981307 19749 debug-util.cc:398] Leaking SignalData structure 0x7b080019ecc0 after lost signal to thread 20133
W20260808 13:48:31.981695 19749 debug-util.cc:398] Leaking SignalData structure 0x7b08001d5c80 after lost signal to thread 20323
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc:784: Failure
Expected equality of these values:
live_row_count
Which is: 67
table_info->GetMetrics()->live_row_count->value()
Which is: 134
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc:768: Failure
Expected: check_function(table_infos[0].get(), live_row_count) doesn't generate new fatal failures in the current thread.
Actual: it does.
I20260808 13:48:33.334451 20323 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc:786: Failure
Expected: GetLeaderMasterAndRun(live_row_count, [&] ( TableInfo* table_info, int64_t live_row_count) { do { AssertEventually([&] () { switch (0) case 0: default: if (const ::testing::AssertionResult gtest_ar_ = ::testing::AssertionResult(table_info->GetMetrics()->TableSupportsLiveRowCount())) ; else return ::testing::internal::AssertHelper(::testing::TestPartResult::kFatalFailure, "/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc", 783, ::testing::internal::GetBoolAssertionFailureMessage( gtest_ar_, "table_info->GetMetrics()->TableSupportsLiveRowCount()", "false", "true") .c_str()) = ::testing::Message(); switch (0) case 0: default: if (const ::testing::AssertionResult gtest_ar = (::testing::internal::EqHelper::Compare("live_row_count", "table_info->GetMetrics()->live_row_count->value()", live_row_count, table_info->GetMetrics()->live_row_count->value()))) ; else return ::testing::internal::AssertHelper(::testing::TestPartResult::kFatalFailure, "/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc", 784, gtest_ar.failure_message()) = ::testing::Message(); }); do { if (testing::Test::HasFatalFailure()) { return; } } while (0); } while (0); }) doesn't generate new fatal failures in the current thread.
Actual: it does.
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/ts_tablet_manager-itest.cc:908: Failure
Expected: CheckStats(kRowsCount) doesn't generate new fatal failures in the current thread.
Actual: it does.
I20260808 13:48:33.343856 17263 tablet_server.cc:179] TabletServer@127.16.219.193:40615 shutting down...
I20260808 13:48:33.348882 20323 catalog_manager.cc:679] Loaded metadata for table NewTableName [id=7a465016c4034f30bbaf5f5046e20548]
I20260808 13:48:33.363781 20323 tablet_loader.cc:96] loaded metadata for tablet 9ee2d1274d4841acb80fab840190d1f6 (table NewTableName [id=7a465016c4034f30bbaf5f5046e20548])
I20260808 13:48:33.365116 20323 tablet_loader.cc:96] loaded metadata for tablet ebb6c443eab04445a885a5150910d735 (table NewTableName [id=7a465016c4034f30bbaf5f5046e20548])
I20260808 13:48:33.369854 20323 tablet_loader.cc:96] loaded metadata for tablet f5931425868b4b63b910f7ceff47dc01 (table NewTableName [id=7a465016c4034f30bbaf5f5046e20548])
I20260808 13:48:33.371291 20323 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 13:48:33.375209 20323 catalog_manager.cc:1295] Loaded cluster ID: 89ddcd6e6f434b32a06787e9c40e4160
I20260808 13:48:33.375563 20323 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 13:48:33.382879 20323 catalog_manager.cc:1540] Loading token signing keys...
I20260808 13:48:33.388808 20323 catalog_manager.cc:6081] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e: Loaded TSK: 0
I20260808 13:48:33.390451 20323 catalog_manager.cc:1550] Initializing in-progress tserver states...
W20260808 13:48:33.395748 19916 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
I20260808 13:48:33.398937 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260808 13:48:33.398991 19916 consensus_peers.cc:597] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad -> Peer de942a19327e426b994b416686c1412a (127.16.219.193:40615): Couldn't send request to peer de942a19327e426b994b416686c1412a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260808 13:48:33.399932 17263 tablet_replica.cc:333] stopping tablet replica
I20260808 13:48:33.400621 17263 raft_consensus.cc:2243] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260808 13:48:33.401111 17263 raft_consensus.cc:2272] T ebb6c443eab04445a885a5150910d735 P de942a19327e426b994b416686c1412a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:33.403496 17263 tablet_replica.cc:333] stopping tablet replica
I20260808 13:48:33.403993 17263 raft_consensus.cc:2243] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 9 FOLLOWER]: Raft consensus shutting down.
I20260808 13:48:33.404453 17263 raft_consensus.cc:2272] T 9ee2d1274d4841acb80fab840190d1f6 P de942a19327e426b994b416686c1412a [term 9 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:33.406435 17263 tablet_replica.cc:333] stopping tablet replica
I20260808 13:48:33.406947 17263 raft_consensus.cc:2243] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260808 13:48:33.407382 17263 raft_consensus.cc:2272] T f5931425868b4b63b910f7ceff47dc01 P de942a19327e426b994b416686c1412a [term 15 FOLLOWER]: Raft consensus is shut down!
W20260808 13:48:33.417701 20046 connection.cc:573] client connection to 127.16.219.193:40615 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 13:48:33.418327 20046 consensus_peers.cc:597] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd -> Peer de942a19327e426b994b416686c1412a (127.16.219.193:40615): Couldn't send request to peer de942a19327e426b994b416686c1412a. Status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260808 13:48:33.421072 20046 consensus_peers.cc:597] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd -> Peer de942a19327e426b994b416686c1412a (127.16.219.193:40615): Couldn't send request to peer de942a19327e426b994b416686c1412a. Status: Network error: Client connection negotiation failed: client connection to 127.16.219.193:40615: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 13:48:33.459218 17263 tablet_server.cc:196] TabletServer@127.16.219.193:40615 shutdown complete.
I20260808 13:48:33.476227 17263 tablet_server.cc:179] TabletServer@127.16.219.194:37283 shutting down...
W20260808 13:48:33.484275 20046 consensus_peers.cc:597] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd -> Peer d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283): Couldn't send request to peer d00890937b5046758a2fb3cd9c79e8ad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260808 13:48:33.495440 20135 heartbeater.cc:499] Master 127.16.219.253:44897 was elected leader, sending a full tablet report...
I20260808 13:48:33.510300 18911 catalog_manager.cc:5697] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd reported cstate change: term changed from 8 to 15, leader changed from de942a19327e426b994b416686c1412a (127.16.219.193) to bad61df9bf4649639959aea33b6d7ccd (127.16.219.195). New cstate: current_term: 15 leader_uuid: "bad61df9bf4649639959aea33b6d7ccd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } health_report { overall_health: HEALTHY } } }
I20260808 13:48:33.511997 20016 heartbeater.cc:499] Master 127.16.219.253:44897 was elected leader, sending a full tablet report...
I20260808 13:48:33.512102 18911 catalog_manager.cc:5697] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd reported cstate change: term changed from 8 to 9, leader changed from d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194) to bad61df9bf4649639959aea33b6d7ccd (127.16.219.195). New cstate: current_term: 9 leader_uuid: "bad61df9bf4649639959aea33b6d7ccd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } health_report { overall_health: HEALTHY } } }
I20260808 13:48:33.513762 18911 catalog_manager.cc:5697] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "d00890937b5046758a2fb3cd9c79e8ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } } }
W20260808 13:48:33.537580 20046 consensus_peers.cc:597] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd -> Peer d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283): Couldn't send request to peer d00890937b5046758a2fb3cd9c79e8ad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260808 13:48:33.570449 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 13:48:33.571174 17263 tablet_replica.cc:333] stopping tablet replica
I20260808 13:48:33.571787 17263 raft_consensus.cc:2243] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 11 LEADER]: Raft consensus shutting down.
I20260808 13:48:33.572590 17263 raft_consensus.cc:2272] T ebb6c443eab04445a885a5150910d735 P d00890937b5046758a2fb3cd9c79e8ad [term 11 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:33.574966 17263 tablet_replica.cc:333] stopping tablet replica
I20260808 13:48:33.575469 17263 raft_consensus.cc:2243] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 9 FOLLOWER]: Raft consensus shutting down.
I20260808 13:48:33.575888 17263 raft_consensus.cc:2272] T 9ee2d1274d4841acb80fab840190d1f6 P d00890937b5046758a2fb3cd9c79e8ad [term 9 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:33.577695 17263 tablet_replica.cc:333] stopping tablet replica
I20260808 13:48:33.578233 17263 raft_consensus.cc:2243] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 15 FOLLOWER]: Raft consensus shutting down.
I20260808 13:48:33.578648 17263 raft_consensus.cc:2272] T f5931425868b4b63b910f7ceff47dc01 P d00890937b5046758a2fb3cd9c79e8ad [term 15 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:33.632514 17263 tablet_server.cc:196] TabletServer@127.16.219.194:37283 shutdown complete.
I20260808 13:48:33.649689 17263 tablet_server.cc:179] TabletServer@127.16.219.195:44613 shutting down...
I20260808 13:48:33.671020 20373 raft_consensus.cc:493] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d00890937b5046758a2fb3cd9c79e8ad)
I20260808 13:48:33.671590 20373 raft_consensus.cc:515] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bad61df9bf4649639959aea33b6d7ccd" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44613 } } peers { permanent_uuid: "de942a19327e426b994b416686c1412a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40615 } } peers { permanent_uuid: "d00890937b5046758a2fb3cd9c79e8ad" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37283 } }
I20260808 13:48:33.674244 20373 leader_election.cc:290] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers de942a19327e426b994b416686c1412a (127.16.219.193:40615), d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283)
W20260808 13:48:33.681401 20046 leader_election.cc:336] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer de942a19327e426b994b416686c1412a (127.16.219.193:40615): Network error: Client connection negotiation failed: client connection to 127.16.219.193:40615: connect: Connection refused (error 111)
W20260808 13:48:33.681931 20046 leader_election.cc:336] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer d00890937b5046758a2fb3cd9c79e8ad (127.16.219.194:37283): Network error: Client connection negotiation failed: client connection to 127.16.219.194:37283: connect: Connection refused (error 111)
I20260808 13:48:33.682305 20046 leader_election.cc:304] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bad61df9bf4649639959aea33b6d7ccd; no voters: d00890937b5046758a2fb3cd9c79e8ad, de942a19327e426b994b416686c1412a
I20260808 13:48:33.683133 20373 raft_consensus.cc:2749] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260808 13:48:33.686551 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 13:48:33.687131 17263 tablet_replica.cc:333] stopping tablet replica
I20260808 13:48:33.687705 17263 raft_consensus.cc:2243] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 11 FOLLOWER]: Raft consensus shutting down.
I20260808 13:48:33.688226 17263 raft_consensus.cc:2272] T ebb6c443eab04445a885a5150910d735 P bad61df9bf4649639959aea33b6d7ccd [term 11 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:33.690256 17263 tablet_replica.cc:333] stopping tablet replica
I20260808 13:48:33.690718 17263 raft_consensus.cc:2243] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 9 LEADER]: Raft consensus shutting down.
I20260808 13:48:33.691474 17263 raft_consensus.cc:2272] T 9ee2d1274d4841acb80fab840190d1f6 P bad61df9bf4649639959aea33b6d7ccd [term 9 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:33.693775 17263 tablet_replica.cc:333] stopping tablet replica
I20260808 13:48:33.694322 17263 raft_consensus.cc:2243] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 15 LEADER]: Raft consensus shutting down.
I20260808 13:48:33.694988 17263 raft_consensus.cc:2272] T f5931425868b4b63b910f7ceff47dc01 P bad61df9bf4649639959aea33b6d7ccd [term 15 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:33.719266 17263 tablet_server.cc:196] TabletServer@127.16.219.195:44613 shutdown complete.
I20260808 13:48:33.733045 17263 master.cc:562] Master@127.16.219.254:37813 shutting down...
W20260808 13:48:33.745918 18897 consensus_peers.cc:597] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e -> Peer b5e2d9219789424c809f622aff07d3f7 (127.16.219.254:37813): Couldn't send request to peer b5e2d9219789424c809f622aff07d3f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 13:48:33.762266 17263 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260808 13:48:33.762764 17263 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b5e2d9219789424c809f622aff07d3f7 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:33.763059 17263 tablet_replica.cc:333] stopping tablet replica
I20260808 13:48:33.811558 17263 master.cc:584] Master@127.16.219.254:37813 shutdown complete.
I20260808 13:48:33.830845 17263 master.cc:562] Master@127.16.219.253:44897 shutting down...
I20260808 13:48:33.854166 20368 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 8 leader_uuid: "c8034ed4c5804b538b25282ddf38e46e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5e2d9219789424c809f622aff07d3f7" member_type: VOTER last_known_addr { host: "127.16.219.254" port: 37813 } } peers { permanent_uuid: "c8034ed4c5804b538b25282ddf38e46e" member_type: VOTER last_known_addr { host: "127.16.219.253" port: 44897 } } peers { permanent_uuid: "43efdd0c2d224907a532c8f81d469c60" member_type: VOTER last_known_addr { host: "127.16.219.252" port: 36493 } } }
I20260808 13:48:33.854898 20368 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [sys.catalog]: This master's current role is: LEADER
I20260808 13:48:33.856231 17263 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 8 LEADER]: Raft consensus shutting down.
I20260808 13:48:33.857335 17263 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e [term 8 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:33.857818 17263 tablet_replica.cc:333] T 00000000000000000000000000000000 P c8034ed4c5804b538b25282ddf38e46e: stopping tablet replica
W20260808 13:48:33.879506 17263 rolling_log.cc:182] Unable to compress old log file: Not found: Unable to open input file to compress: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0/ts_tablet_manager-itest.dist-test-slave-mn4r.slave.diagnostics.20260808-134754.1.17263: No such file or directory (error 2)
I20260808 13:48:33.880275 17263 master.cc:584] Master@127.16.219.253:44897 shutdown complete.
I20260808 13:48:33.899612 17263 master.cc:562] Master@127.16.219.252:36493 shutting down...
I20260808 13:48:33.921586 17263 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260808 13:48:33.922225 17263 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 43efdd0c2d224907a532c8f81d469c60 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:33.922582 17263 tablet_replica.cc:333] stopping tablet replica
I20260808 13:48:33.962232 17263 master.cc:584] Master@127.16.219.252:36493 shutdown complete.
I20260808 13:48:33.988438 17263 test_util.cc:182] -----------------------------------------------
I20260808 13:48:33.988636 17263 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestTableStats.1786196858807110-17263-0
[ FAILED ] TsTabletManagerITest.TestTableStats (39295 ms)
[ RUN ] TsTabletManagerITest.TestDeleteTableDuringTabletCopy
I20260808 13:48:33.995471 17263 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.219.254:34551
I20260808 13:48:33.996696 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:48:34.001983 20396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:34.003167 20397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:48:34.004667 17263 server_base.cc:1061] running on GCE node
W20260808 13:48:34.004647 20399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:48:34.007246 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:48:34.007429 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:48:34.007544 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196914007533 us; error 0 us; skew 500 ppm
I20260808 13:48:34.007989 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:48:34.010386 17263 webserver.cc:533] Webserver started at http://127.16.219.254:39055/ using document root <none> and password file <none>
I20260808 13:48:34.010834 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:48:34.010999 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:48:34.011206 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:48:34.012290 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786196858807110-17263-0/minicluster-data/master-0-root/instance:
uuid: "1cd925b03f874185b2dcd3af4f02f461"
format_stamp: "Formatted at 2026-08-08 13:48:34 on dist-test-slave-mn4r"
I20260808 13:48:34.016773 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 13:48:34.020068 20405 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:34.020802 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 13:48:34.021096 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786196858807110-17263-0/minicluster-data/master-0-root
uuid: "1cd925b03f874185b2dcd3af4f02f461"
format_stamp: "Formatted at 2026-08-08 13:48:34 on dist-test-slave-mn4r"
I20260808 13:48:34.021373 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786196858807110-17263-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786196858807110-17263-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786196858807110-17263-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:48:34.050604 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:48:34.051928 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:48:34.092010 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.254:34551
I20260808 13:48:34.092175 20461 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.254:34551 every 8 connection(s)
I20260808 13:48:34.096416 20462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:48:34.106555 20462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1cd925b03f874185b2dcd3af4f02f461: Bootstrap starting.
I20260808 13:48:34.111604 20462 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1cd925b03f874185b2dcd3af4f02f461: Neither blocks nor log segments found. Creating new log.
I20260808 13:48:34.115890 20462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1cd925b03f874185b2dcd3af4f02f461: No bootstrap required, opened a new log
I20260808 13:48:34.118181 20462 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1cd925b03f874185b2dcd3af4f02f461 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cd925b03f874185b2dcd3af4f02f461" member_type: VOTER }
I20260808 13:48:34.118577 20462 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1cd925b03f874185b2dcd3af4f02f461 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:48:34.118834 20462 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1cd925b03f874185b2dcd3af4f02f461 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cd925b03f874185b2dcd3af4f02f461, State: Initialized, Role: FOLLOWER
I20260808 13:48:34.119460 20462 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1cd925b03f874185b2dcd3af4f02f461 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cd925b03f874185b2dcd3af4f02f461" member_type: VOTER }
I20260808 13:48:34.119940 20462 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1cd925b03f874185b2dcd3af4f02f461 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 13:48:34.120172 20462 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1cd925b03f874185b2dcd3af4f02f461 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 13:48:34.120445 20462 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1cd925b03f874185b2dcd3af4f02f461 [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:48:34.125250 20462 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1cd925b03f874185b2dcd3af4f02f461 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cd925b03f874185b2dcd3af4f02f461" member_type: VOTER }
I20260808 13:48:34.125779 20462 leader_election.cc:304] T 00000000000000000000000000000000 P 1cd925b03f874185b2dcd3af4f02f461 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1cd925b03f874185b2dcd3af4f02f461; no voters:
I20260808 13:48:34.126976 20462 leader_election.cc:290] T 00000000000000000000000000000000 P 1cd925b03f874185b2dcd3af4f02f461 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 13:48:34.127444 20467 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1cd925b03f874185b2dcd3af4f02f461 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 13:48:34.128925 20467 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1cd925b03f874185b2dcd3af4f02f461 [term 1 LEADER]: Becoming Leader. State: Replica: 1cd925b03f874185b2dcd3af4f02f461, State: Running, Role: LEADER
I20260808 13:48:34.129683 20467 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1cd925b03f874185b2dcd3af4f02f461 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cd925b03f874185b2dcd3af4f02f461" member_type: VOTER }
I20260808 13:48:34.129964 20462 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1cd925b03f874185b2dcd3af4f02f461 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 13:48:34.134877 20468 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1cd925b03f874185b2dcd3af4f02f461 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1cd925b03f874185b2dcd3af4f02f461" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cd925b03f874185b2dcd3af4f02f461" member_type: VOTER } }
I20260808 13:48:34.135654 20468 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1cd925b03f874185b2dcd3af4f02f461 [sys.catalog]: This master's current role is: LEADER
I20260808 13:48:34.137017 20469 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1cd925b03f874185b2dcd3af4f02f461 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1cd925b03f874185b2dcd3af4f02f461. Latest consensus state: current_term: 1 leader_uuid: "1cd925b03f874185b2dcd3af4f02f461" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cd925b03f874185b2dcd3af4f02f461" member_type: VOTER } }
I20260808 13:48:34.137652 20469 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1cd925b03f874185b2dcd3af4f02f461 [sys.catalog]: This master's current role is: LEADER
I20260808 13:48:34.138062 20475 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 13:48:34.147805 20475 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 13:48:34.154752 17263 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260808 13:48:34.158317 20475 catalog_manager.cc:1383] Generated new cluster ID: 1108ef7a5c134cfab250d5cd6101491f
I20260808 13:48:34.158601 20475 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 13:48:34.189056 20475 catalog_manager.cc:1406] Generated new certificate authority record
I20260808 13:48:34.190407 20475 catalog_manager.cc:1540] Loading token signing keys...
I20260808 13:48:34.205341 20475 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1cd925b03f874185b2dcd3af4f02f461: Generated new TSK 0
I20260808 13:48:34.205973 20475 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 13:48:34.221575 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:48:34.228019 20485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:34.229161 20486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:34.230684 20488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:48:34.230981 17263 server_base.cc:1061] running on GCE node
I20260808 13:48:34.232414 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:48:34.232590 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:48:34.232704 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196914232694 us; error 0 us; skew 500 ppm
I20260808 13:48:34.233163 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:48:34.235666 17263 webserver.cc:533] Webserver started at http://127.16.219.193:42967/ using document root <none> and password file <none>
I20260808 13:48:34.236116 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:48:34.236269 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:48:34.236470 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:48:34.237478 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786196858807110-17263-0/minicluster-data/ts-0-root/instance:
uuid: "1a001e6269ff4333af5d3f6ce0f8fdda"
format_stamp: "Formatted at 2026-08-08 13:48:34 on dist-test-slave-mn4r"
I20260808 13:48:34.242014 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260808 13:48:34.245395 20496 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:34.246198 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 13:48:34.246483 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786196858807110-17263-0/minicluster-data/ts-0-root
uuid: "1a001e6269ff4333af5d3f6ce0f8fdda"
format_stamp: "Formatted at 2026-08-08 13:48:34 on dist-test-slave-mn4r"
I20260808 13:48:34.246758 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786196858807110-17263-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786196858807110-17263-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786196858807110-17263-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:48:34.262293 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:48:34.263479 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:48:34.264899 17263 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 13:48:34.267247 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 13:48:34.267465 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:34.267719 17263 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 13:48:34.267901 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:34.309091 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.193:46169
I20260808 13:48:34.309216 20561 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.193:46169 every 8 connection(s)
I20260808 13:48:34.314360 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:48:34.322320 20567 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:34.324780 20568 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:48:34.325232 17263 server_base.cc:1061] running on GCE node
W20260808 13:48:34.327034 20570 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:48:34.328199 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:48:34.328516 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:48:34.328737 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196914328718 us; error 0 us; skew 500 ppm
I20260808 13:48:34.329445 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:48:34.330116 20562 heartbeater.cc:344] Connected to a master server at 127.16.219.254:34551
I20260808 13:48:34.330518 20562 heartbeater.cc:461] Registering TS with master...
I20260808 13:48:34.331416 20562 heartbeater.cc:507] Master 127.16.219.254:34551 requested a full tablet report, sending...
I20260808 13:48:34.332397 17263 webserver.cc:533] Webserver started at http://127.16.219.194:40623/ using document root <none> and password file <none>
I20260808 13:48:34.333012 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:48:34.333276 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:48:34.333613 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:48:34.333891 20424 ts_manager.cc:194] Registered new tserver with Master: 1a001e6269ff4333af5d3f6ce0f8fdda (127.16.219.193:46169)
I20260808 13:48:34.335147 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786196858807110-17263-0/minicluster-data/ts-1-root/instance:
uuid: "7c9629fb49dd43eab71cad0e950c9914"
format_stamp: "Formatted at 2026-08-08 13:48:34 on dist-test-slave-mn4r"
I20260808 13:48:34.336417 20424 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50196
I20260808 13:48:34.340469 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 13:48:34.343969 20576 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:34.344705 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 13:48:34.344964 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786196858807110-17263-0/minicluster-data/ts-1-root
uuid: "7c9629fb49dd43eab71cad0e950c9914"
format_stamp: "Formatted at 2026-08-08 13:48:34 on dist-test-slave-mn4r"
I20260808 13:48:34.345194 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786196858807110-17263-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786196858807110-17263-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786196858807110-17263-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:48:34.364820 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:48:34.365996 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:48:34.367494 17263 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 13:48:34.369757 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 13:48:34.369926 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:34.370239 17263 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 13:48:34.370383 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:34.412015 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.194:37981
I20260808 13:48:34.412118 20647 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.194:37981 every 8 connection(s)
I20260808 13:48:34.416893 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:48:34.423749 20652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:34.424855 20653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:34.427716 20655 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:48:34.431214 17263 server_base.cc:1061] running on GCE node
I20260808 13:48:34.432189 20649 heartbeater.cc:344] Connected to a master server at 127.16.219.254:34551
I20260808 13:48:34.432299 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260808 13:48:34.432586 20649 heartbeater.cc:461] Registering TS with master...
W20260808 13:48:34.432600 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:48:34.433071 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196914433053 us; error 0 us; skew 500 ppm
I20260808 13:48:34.433544 20649 heartbeater.cc:507] Master 127.16.219.254:34551 requested a full tablet report, sending...
I20260808 13:48:34.433667 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:48:34.435948 20424 ts_manager.cc:194] Registered new tserver with Master: 7c9629fb49dd43eab71cad0e950c9914 (127.16.219.194:37981)
I20260808 13:48:34.436563 17263 webserver.cc:533] Webserver started at http://127.16.219.195:46487/ using document root <none> and password file <none>
I20260808 13:48:34.437100 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:48:34.437302 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:48:34.437562 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:48:34.437491 20424 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50202
I20260808 13:48:34.439075 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786196858807110-17263-0/minicluster-data/ts-2-root/instance:
uuid: "5d0d743399ea4e888cbf986cfc9ba362"
format_stamp: "Formatted at 2026-08-08 13:48:34 on dist-test-slave-mn4r"
I20260808 13:48:34.443451 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 13:48:34.446904 20661 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:34.447849 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260808 13:48:34.448143 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786196858807110-17263-0/minicluster-data/ts-2-root
uuid: "5d0d743399ea4e888cbf986cfc9ba362"
format_stamp: "Formatted at 2026-08-08 13:48:34 on dist-test-slave-mn4r"
I20260808 13:48:34.448491 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786196858807110-17263-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786196858807110-17263-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786196858807110-17263-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:48:34.458737 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:48:34.459946 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:48:34.461387 17263 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 13:48:34.463639 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 13:48:34.463862 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:34.464092 17263 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 13:48:34.464254 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:34.505429 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.195:41087
I20260808 13:48:34.505553 20726 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.195:41087 every 8 connection(s)
I20260808 13:48:34.519070 20727 heartbeater.cc:344] Connected to a master server at 127.16.219.254:34551
I20260808 13:48:34.519496 20727 heartbeater.cc:461] Registering TS with master...
I20260808 13:48:34.520210 20727 heartbeater.cc:507] Master 127.16.219.254:34551 requested a full tablet report, sending...
I20260808 13:48:34.522156 20424 ts_manager.cc:194] Registered new tserver with Master: 5d0d743399ea4e888cbf986cfc9ba362 (127.16.219.195:41087)
I20260808 13:48:34.522327 17263 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013604457s
I20260808 13:48:34.523588 20424 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50210
I20260808 13:48:34.556494 20424 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50218:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
}
}
W20260808 13:48:34.558183 20424 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 13:48:34.607748 20525 tablet_service.cc:1511] Processing CreateTablet for tablet 66639234f97f4081bfc203de9774e005 (DEFAULT_TABLE table=test-table [id=1b7d6bd22a3e40b59293527e9392e15e]), partition=
I20260808 13:48:34.609052 20525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66639234f97f4081bfc203de9774e005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:48:34.609462 20607 tablet_service.cc:1511] Processing CreateTablet for tablet 66639234f97f4081bfc203de9774e005 (DEFAULT_TABLE table=test-table [id=1b7d6bd22a3e40b59293527e9392e15e]), partition=
I20260808 13:48:34.610543 20607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66639234f97f4081bfc203de9774e005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:48:34.612097 20689 tablet_service.cc:1511] Processing CreateTablet for tablet 66639234f97f4081bfc203de9774e005 (DEFAULT_TABLE table=test-table [id=1b7d6bd22a3e40b59293527e9392e15e]), partition=
I20260808 13:48:34.613200 20689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66639234f97f4081bfc203de9774e005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:48:34.627744 20746 tablet_bootstrap.cc:492] T 66639234f97f4081bfc203de9774e005 P 5d0d743399ea4e888cbf986cfc9ba362: Bootstrap starting.
I20260808 13:48:34.628310 20745 tablet_bootstrap.cc:492] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda: Bootstrap starting.
I20260808 13:48:34.634644 20745 tablet_bootstrap.cc:654] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda: Neither blocks nor log segments found. Creating new log.
I20260808 13:48:34.635428 20747 tablet_bootstrap.cc:492] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914: Bootstrap starting.
I20260808 13:48:34.635895 20746 tablet_bootstrap.cc:654] T 66639234f97f4081bfc203de9774e005 P 5d0d743399ea4e888cbf986cfc9ba362: Neither blocks nor log segments found. Creating new log.
I20260808 13:48:34.641608 20745 tablet_bootstrap.cc:492] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda: No bootstrap required, opened a new log
I20260808 13:48:34.641716 20746 tablet_bootstrap.cc:492] T 66639234f97f4081bfc203de9774e005 P 5d0d743399ea4e888cbf986cfc9ba362: No bootstrap required, opened a new log
I20260808 13:48:34.642127 20745 ts_tablet_manager.cc:1403] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda: Time spent bootstrapping tablet: real 0.014s user 0.010s sys 0.002s
I20260808 13:48:34.642302 20746 ts_tablet_manager.cc:1403] T 66639234f97f4081bfc203de9774e005 P 5d0d743399ea4e888cbf986cfc9ba362: Time spent bootstrapping tablet: real 0.015s user 0.011s sys 0.002s
I20260808 13:48:34.643292 20747 tablet_bootstrap.cc:654] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914: Neither blocks nor log segments found. Creating new log.
I20260808 13:48:34.645314 20745 raft_consensus.cc:359] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a001e6269ff4333af5d3f6ce0f8fdda" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46169 } } peers { permanent_uuid: "5d0d743399ea4e888cbf986cfc9ba362" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 41087 } } peers { permanent_uuid: "7c9629fb49dd43eab71cad0e950c9914" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37981 } }
I20260808 13:48:34.646097 20745 raft_consensus.cc:385] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:48:34.645593 20746 raft_consensus.cc:359] T 66639234f97f4081bfc203de9774e005 P 5d0d743399ea4e888cbf986cfc9ba362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a001e6269ff4333af5d3f6ce0f8fdda" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46169 } } peers { permanent_uuid: "5d0d743399ea4e888cbf986cfc9ba362" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 41087 } } peers { permanent_uuid: "7c9629fb49dd43eab71cad0e950c9914" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37981 } }
I20260808 13:48:34.646487 20745 raft_consensus.cc:740] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a001e6269ff4333af5d3f6ce0f8fdda, State: Initialized, Role: FOLLOWER
I20260808 13:48:34.646649 20746 raft_consensus.cc:385] T 66639234f97f4081bfc203de9774e005 P 5d0d743399ea4e888cbf986cfc9ba362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:48:34.647158 20746 raft_consensus.cc:740] T 66639234f97f4081bfc203de9774e005 P 5d0d743399ea4e888cbf986cfc9ba362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0d743399ea4e888cbf986cfc9ba362, State: Initialized, Role: FOLLOWER
I20260808 13:48:34.647351 20745 consensus_queue.cc:260] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a001e6269ff4333af5d3f6ce0f8fdda" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46169 } } peers { permanent_uuid: "5d0d743399ea4e888cbf986cfc9ba362" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 41087 } } peers { permanent_uuid: "7c9629fb49dd43eab71cad0e950c9914" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37981 } }
I20260808 13:48:34.648193 20746 consensus_queue.cc:260] T 66639234f97f4081bfc203de9774e005 P 5d0d743399ea4e888cbf986cfc9ba362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a001e6269ff4333af5d3f6ce0f8fdda" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46169 } } peers { permanent_uuid: "5d0d743399ea4e888cbf986cfc9ba362" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 41087 } } peers { permanent_uuid: "7c9629fb49dd43eab71cad0e950c9914" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37981 } }
I20260808 13:48:34.650194 20562 heartbeater.cc:499] Master 127.16.219.254:34551 was elected leader, sending a full tablet report...
I20260808 13:48:34.650601 20745 ts_tablet_manager.cc:1434] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
W20260808 13:48:34.650985 20745 ts_tablet_manager.cc:1457] Injecting 50ms of latency into OpenTablet
I20260808 13:48:34.652733 20727 heartbeater.cc:499] Master 127.16.219.254:34551 was elected leader, sending a full tablet report...
I20260808 13:48:34.653479 20746 ts_tablet_manager.cc:1434] T 66639234f97f4081bfc203de9774e005 P 5d0d743399ea4e888cbf986cfc9ba362: Time spent starting tablet: real 0.011s user 0.005s sys 0.004s
W20260808 13:48:34.653870 20746 ts_tablet_manager.cc:1457] Injecting 50ms of latency into OpenTablet
I20260808 13:48:34.657061 20747 tablet_bootstrap.cc:492] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914: No bootstrap required, opened a new log
I20260808 13:48:34.657456 20747 ts_tablet_manager.cc:1403] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914: Time spent bootstrapping tablet: real 0.022s user 0.011s sys 0.008s
I20260808 13:48:34.660195 20747 raft_consensus.cc:359] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a001e6269ff4333af5d3f6ce0f8fdda" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46169 } } peers { permanent_uuid: "5d0d743399ea4e888cbf986cfc9ba362" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 41087 } } peers { permanent_uuid: "7c9629fb49dd43eab71cad0e950c9914" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37981 } }
I20260808 13:48:34.660835 20747 raft_consensus.cc:385] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:48:34.661113 20747 raft_consensus.cc:740] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c9629fb49dd43eab71cad0e950c9914, State: Initialized, Role: FOLLOWER
I20260808 13:48:34.661731 20747 consensus_queue.cc:260] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a001e6269ff4333af5d3f6ce0f8fdda" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46169 } } peers { permanent_uuid: "5d0d743399ea4e888cbf986cfc9ba362" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 41087 } } peers { permanent_uuid: "7c9629fb49dd43eab71cad0e950c9914" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37981 } }
I20260808 13:48:34.663512 20649 heartbeater.cc:499] Master 127.16.219.254:34551 was elected leader, sending a full tablet report...
I20260808 13:48:34.663856 20747 ts_tablet_manager.cc:1434] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914: Time spent starting tablet: real 0.006s user 0.004s sys 0.004s
W20260808 13:48:34.664178 20747 ts_tablet_manager.cc:1457] Injecting 50ms of latency into OpenTablet
W20260808 13:48:34.665787 20650 tablet.cc:2406] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 13:48:34.957355 20751 raft_consensus.cc:493] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 13:48:34.957918 20751 raft_consensus.cc:515] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a001e6269ff4333af5d3f6ce0f8fdda" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46169 } } peers { permanent_uuid: "5d0d743399ea4e888cbf986cfc9ba362" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 41087 } } peers { permanent_uuid: "7c9629fb49dd43eab71cad0e950c9914" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37981 } }
I20260808 13:48:34.960173 20751 leader_election.cc:290] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0d743399ea4e888cbf986cfc9ba362 (127.16.219.195:41087), 7c9629fb49dd43eab71cad0e950c9914 (127.16.219.194:37981)
I20260808 13:48:34.969990 20699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66639234f97f4081bfc203de9774e005" candidate_uuid: "1a001e6269ff4333af5d3f6ce0f8fdda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0d743399ea4e888cbf986cfc9ba362" is_pre_election: true
I20260808 13:48:34.970132 20617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66639234f97f4081bfc203de9774e005" candidate_uuid: "1a001e6269ff4333af5d3f6ce0f8fdda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c9629fb49dd43eab71cad0e950c9914" is_pre_election: true
I20260808 13:48:34.970829 20699 raft_consensus.cc:2468] T 66639234f97f4081bfc203de9774e005 P 5d0d743399ea4e888cbf986cfc9ba362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a001e6269ff4333af5d3f6ce0f8fdda in term 0.
I20260808 13:48:34.971276 20617 raft_consensus.cc:2468] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a001e6269ff4333af5d3f6ce0f8fdda in term 0.
I20260808 13:48:34.971948 20498 leader_election.cc:304] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a001e6269ff4333af5d3f6ce0f8fdda, 5d0d743399ea4e888cbf986cfc9ba362; no voters:
I20260808 13:48:34.972677 20751 raft_consensus.cc:2804] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 13:48:34.973037 20751 raft_consensus.cc:493] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 13:48:34.973323 20751 raft_consensus.cc:3060] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:48:34.977977 20751 raft_consensus.cc:515] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a001e6269ff4333af5d3f6ce0f8fdda" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46169 } } peers { permanent_uuid: "5d0d743399ea4e888cbf986cfc9ba362" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 41087 } } peers { permanent_uuid: "7c9629fb49dd43eab71cad0e950c9914" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37981 } }
I20260808 13:48:34.979637 20751 leader_election.cc:290] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda [CANDIDATE]: Term 1 election: Requested vote from peers 5d0d743399ea4e888cbf986cfc9ba362 (127.16.219.195:41087), 7c9629fb49dd43eab71cad0e950c9914 (127.16.219.194:37981)
I20260808 13:48:34.980388 20699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66639234f97f4081bfc203de9774e005" candidate_uuid: "1a001e6269ff4333af5d3f6ce0f8fdda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0d743399ea4e888cbf986cfc9ba362"
I20260808 13:48:34.980682 20617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66639234f97f4081bfc203de9774e005" candidate_uuid: "1a001e6269ff4333af5d3f6ce0f8fdda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c9629fb49dd43eab71cad0e950c9914"
I20260808 13:48:34.980999 20699 raft_consensus.cc:3060] T 66639234f97f4081bfc203de9774e005 P 5d0d743399ea4e888cbf986cfc9ba362 [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:48:34.981231 20617 raft_consensus.cc:3060] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914 [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:48:34.988108 20617 raft_consensus.cc:2468] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a001e6269ff4333af5d3f6ce0f8fdda in term 1.
I20260808 13:48:34.988108 20699 raft_consensus.cc:2468] T 66639234f97f4081bfc203de9774e005 P 5d0d743399ea4e888cbf986cfc9ba362 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a001e6269ff4333af5d3f6ce0f8fdda in term 1.
I20260808 13:48:34.989333 20498 leader_election.cc:304] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a001e6269ff4333af5d3f6ce0f8fdda, 5d0d743399ea4e888cbf986cfc9ba362; no voters:
I20260808 13:48:34.989976 20751 raft_consensus.cc:2804] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda [term 1 FOLLOWER]: Leader election won for term 1
I20260808 13:48:34.990947 20751 raft_consensus.cc:697] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda [term 1 LEADER]: Becoming Leader. State: Replica: 1a001e6269ff4333af5d3f6ce0f8fdda, State: Running, Role: LEADER
I20260808 13:48:34.991734 20751 consensus_queue.cc:237] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a001e6269ff4333af5d3f6ce0f8fdda" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46169 } } peers { permanent_uuid: "5d0d743399ea4e888cbf986cfc9ba362" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 41087 } } peers { permanent_uuid: "7c9629fb49dd43eab71cad0e950c9914" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37981 } }
I20260808 13:48:34.998133 20422 catalog_manager.cc:5697] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a001e6269ff4333af5d3f6ce0f8fdda (127.16.219.193). New cstate: current_term: 1 leader_uuid: "1a001e6269ff4333af5d3f6ce0f8fdda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a001e6269ff4333af5d3f6ce0f8fdda" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46169 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0d743399ea4e888cbf986cfc9ba362" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 41087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c9629fb49dd43eab71cad0e950c9914" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37981 } health_report { overall_health: UNKNOWN } } }
I20260808 13:48:35.084723 20607 tablet_service.cc:1558] Processing DeleteTablet for tablet 66639234f97f4081bfc203de9774e005 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:48996
I20260808 13:48:35.086421 20759 tablet_replica.cc:333] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914: stopping tablet replica
I20260808 13:48:35.087090 20759 raft_consensus.cc:2243] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 13:48:35.087563 20759 raft_consensus.cc:2272] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:35.089749 20759 ts_tablet_manager.cc:1916] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260808 13:48:35.099851 20759 ts_tablet_manager.cc:1929] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 0.0
I20260808 13:48:35.100219 20759 log.cc:1199] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914: Deleting WAL directory at /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786196858807110-17263-0/minicluster-data/ts-1-root/wals/66639234f97f4081bfc203de9774e005
I20260808 13:48:35.104465 20760 ts_tablet_manager.cc:933] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914: Initiating tablet copy from peer 1a001e6269ff4333af5d3f6ce0f8fdda (127.16.219.193:46169)
I20260808 13:48:35.106614 20760 tablet_copy_client.cc:323] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914: tablet copy: Beginning tablet copy session from remote peer at address 127.16.219.193:46169
I20260808 13:48:35.115511 20545 tablet_copy_service.cc:140] P 1a001e6269ff4333af5d3f6ce0f8fdda: Received BeginTabletCopySession request for tablet 66639234f97f4081bfc203de9774e005 from peer 7c9629fb49dd43eab71cad0e950c9914 ({username='slave'} at 127.0.0.1:41850)
I20260808 13:48:35.115999 20545 tablet_copy_service.cc:161] P 1a001e6269ff4333af5d3f6ce0f8fdda: Beginning new tablet copy session on tablet 66639234f97f4081bfc203de9774e005 from peer 7c9629fb49dd43eab71cad0e950c9914 at {username='slave'} at 127.0.0.1:41850: session id = 7c9629fb49dd43eab71cad0e950c9914-66639234f97f4081bfc203de9774e005
I20260808 13:48:35.122599 20545 tablet_copy_source_session.cc:215] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 13:48:35.125227 20760 ts_tablet_manager.cc:1916] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260808 13:48:35.135169 20760 ts_tablet_manager.cc:1929] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 0.0
I20260808 13:48:35.135737 20760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66639234f97f4081bfc203de9774e005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:48:35.140667 20760 tablet_copy_client.cc:806] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914: tablet copy: Starting download of 0 data blocks...
I20260808 13:48:35.141284 20760 tablet_copy_client.cc:670] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914: tablet copy: Starting download of 1 WAL segments...
I20260808 13:48:35.143165 20422 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50226:
table { table_id: "1b7d6bd22a3e40b59293527e9392e15e" table_name: "test-table" }
I20260808 13:48:35.143834 20422 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:50226:
table { table_id: "1b7d6bd22a3e40b59293527e9392e15e" table_name: "test-table" }
I20260808 13:48:35.145533 20760 tablet_copy_client.cc:538] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 13:48:35.152462 20760 tablet_bootstrap.cc:492] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914: Bootstrap starting.
I20260808 13:48:35.154958 20422 catalog_manager.cc:5984] T 00000000000000000000000000000000 P 1cd925b03f874185b2dcd3af4f02f461: Sending DeleteTablet for 3 replicas of tablet 66639234f97f4081bfc203de9774e005
I20260808 13:48:35.157006 20525 tablet_service.cc:1558] Processing DeleteTablet for tablet 66639234f97f4081bfc203de9774e005 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 13:48:35 UTC) from {username='slave'} at 127.0.0.1:41832
I20260808 13:48:35.157526 20689 tablet_service.cc:1558] Processing DeleteTablet for tablet 66639234f97f4081bfc203de9774e005 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 13:48:35 UTC) from {username='slave'} at 127.0.0.1:38016
I20260808 13:48:35.157970 20607 tablet_service.cc:1558] Processing DeleteTablet for tablet 66639234f97f4081bfc203de9774e005 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 13:48:35 UTC) from {username='slave'} at 127.0.0.1:48980
I20260808 13:48:35.161960 20763 tablet_replica.cc:333] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda: stopping tablet replica
I20260808 13:48:35.162900 20763 raft_consensus.cc:2243] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda [term 1 LEADER]: Raft consensus shutting down.
I20260808 13:48:35.162015 20764 tablet_replica.cc:333] T 66639234f97f4081bfc203de9774e005 P 5d0d743399ea4e888cbf986cfc9ba362: stopping tablet replica
W20260808 13:48:35.162818 20408 catalog_manager.cc:5008] TS 7c9629fb49dd43eab71cad0e950c9914 (127.16.219.194:37981): delete failed for tablet 66639234f97f4081bfc203de9774e005 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66639234f97f4081bfc203de9774e005 already in progress: copying tablet
I20260808 13:48:35.163866 20763 pending_rounds.cc:70] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda: Trying to abort 1 pending ops.
I20260808 13:48:35.164172 20763 pending_rounds.cc:77] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316262563813806080 op_type: NO_OP noop_request { }
I20260808 13:48:35.164521 20764 raft_consensus.cc:2243] T 66639234f97f4081bfc203de9774e005 P 5d0d743399ea4e888cbf986cfc9ba362 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 13:48:35.164724 20763 raft_consensus.cc:2889] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260808 13:48:35.165194 20763 raft_consensus.cc:2272] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:35.165306 20764 raft_consensus.cc:2272] T 66639234f97f4081bfc203de9774e005 P 5d0d743399ea4e888cbf986cfc9ba362 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:35.167541 20763 ts_tablet_manager.cc:1916] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 13:48:35.168656 20764 ts_tablet_manager.cc:1916] T 66639234f97f4081bfc203de9774e005 P 5d0d743399ea4e888cbf986cfc9ba362: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 13:48:35.174327 20760 tablet_bootstrap.cc:492] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260808 13:48:35.175253 20760 tablet_bootstrap.cc:492] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914: Bootstrap complete.
I20260808 13:48:35.175915 20760 ts_tablet_manager.cc:1403] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914: Time spent bootstrapping tablet: real 0.024s user 0.015s sys 0.008s
I20260808 13:48:35.179023 20760 raft_consensus.cc:359] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a001e6269ff4333af5d3f6ce0f8fdda" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46169 } } peers { permanent_uuid: "5d0d743399ea4e888cbf986cfc9ba362" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 41087 } } peers { permanent_uuid: "7c9629fb49dd43eab71cad0e950c9914" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37981 } }
I20260808 13:48:35.179913 20760 raft_consensus.cc:740] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c9629fb49dd43eab71cad0e950c9914, State: Initialized, Role: FOLLOWER
I20260808 13:48:35.180135 20764 ts_tablet_manager.cc:1929] T 66639234f97f4081bfc203de9774e005 P 5d0d743399ea4e888cbf986cfc9ba362: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260808 13:48:35.180598 20764 log.cc:1199] T 66639234f97f4081bfc203de9774e005 P 5d0d743399ea4e888cbf986cfc9ba362: Deleting WAL directory at /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786196858807110-17263-0/minicluster-data/ts-2-root/wals/66639234f97f4081bfc203de9774e005
I20260808 13:48:35.181239 20764 ts_tablet_manager.cc:1950] T 66639234f97f4081bfc203de9774e005 P 5d0d743399ea4e888cbf986cfc9ba362: Deleting consensus metadata
I20260808 13:48:35.180760 20760 consensus_queue.cc:260] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a001e6269ff4333af5d3f6ce0f8fdda" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 46169 } } peers { permanent_uuid: "5d0d743399ea4e888cbf986cfc9ba362" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 41087 } } peers { permanent_uuid: "7c9629fb49dd43eab71cad0e950c9914" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 37981 } }
I20260808 13:48:35.183068 20763 ts_tablet_manager.cc:1929] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260808 13:48:35.183522 20763 log.cc:1199] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda: Deleting WAL directory at /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786196858807110-17263-0/minicluster-data/ts-0-root/wals/66639234f97f4081bfc203de9774e005
I20260808 13:48:35.183795 20760 ts_tablet_manager.cc:1434] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914: Time spent starting tablet: real 0.008s user 0.006s sys 0.002s
W20260808 13:48:35.184185 20760 ts_tablet_manager.cc:1457] Injecting 50ms of latency into OpenTablet
I20260808 13:48:35.184306 20763 ts_tablet_manager.cc:1950] T 66639234f97f4081bfc203de9774e005 P 1a001e6269ff4333af5d3f6ce0f8fdda: Deleting consensus metadata
I20260808 13:48:35.184967 20406 catalog_manager.cc:5028] TS 5d0d743399ea4e888cbf986cfc9ba362 (127.16.219.195:41087): tablet 66639234f97f4081bfc203de9774e005 (table test-table [id=1b7d6bd22a3e40b59293527e9392e15e]) successfully deleted
I20260808 13:48:35.185920 20407 catalog_manager.cc:5028] TS 1a001e6269ff4333af5d3f6ce0f8fdda (127.16.219.193:46169): tablet 66639234f97f4081bfc203de9774e005 (table test-table [id=1b7d6bd22a3e40b59293527e9392e15e]) successfully deleted
I20260808 13:48:35.188825 20607 tablet_service.cc:1558] Processing DeleteTablet for tablet 66639234f97f4081bfc203de9774e005 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 13:48:35 UTC) from {username='slave'} at 127.0.0.1:48980
W20260808 13:48:35.190191 20408 catalog_manager.cc:5008] TS 7c9629fb49dd43eab71cad0e950c9914 (127.16.219.194:37981): delete failed for tablet 66639234f97f4081bfc203de9774e005 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66639234f97f4081bfc203de9774e005 already in progress: copying tablet
I20260808 13:48:35.236575 20545 tablet_copy_service.cc:342] P 1a001e6269ff4333af5d3f6ce0f8fdda: Request end of tablet copy session 7c9629fb49dd43eab71cad0e950c9914-66639234f97f4081bfc203de9774e005 received from {username='slave'} at 127.0.0.1:41850
I20260808 13:48:35.237129 20545 tablet_copy_service.cc:434] P 1a001e6269ff4333af5d3f6ce0f8fdda: ending tablet copy session 7c9629fb49dd43eab71cad0e950c9914-66639234f97f4081bfc203de9774e005 on tablet 66639234f97f4081bfc203de9774e005 with peer 7c9629fb49dd43eab71cad0e950c9914
I20260808 13:48:35.240525 20607 tablet_service.cc:1558] Processing DeleteTablet for tablet 66639234f97f4081bfc203de9774e005 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 13:48:35 UTC) from {username='slave'} at 127.0.0.1:48980
I20260808 13:48:35.241281 20759 tablet_replica.cc:333] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914: stopping tablet replica
I20260808 13:48:35.241904 20759 raft_consensus.cc:2243] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 13:48:35.242342 20759 pending_rounds.cc:70] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914: Trying to abort 1 pending ops.
I20260808 13:48:35.242549 20759 pending_rounds.cc:77] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316262563813806080 op_type: NO_OP noop_request { }
I20260808 13:48:35.242851 20759 raft_consensus.cc:2889] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260808 13:48:35.243182 20759 raft_consensus.cc:2272] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:35.245280 20759 ts_tablet_manager.cc:1916] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 13:48:35.255285 20759 ts_tablet_manager.cc:1929] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260808 13:48:35.255586 20759 log.cc:1199] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914: Deleting WAL directory at /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TsTabletManagerITest.TestDeleteTableDuringTabletCopy.1786196858807110-17263-0/minicluster-data/ts-1-root/wals/66639234f97f4081bfc203de9774e005
I20260808 13:48:35.256223 20759 ts_tablet_manager.cc:1950] T 66639234f97f4081bfc203de9774e005 P 7c9629fb49dd43eab71cad0e950c9914: Deleting consensus metadata
I20260808 13:48:35.258517 20408 catalog_manager.cc:5028] TS 7c9629fb49dd43eab71cad0e950c9914 (127.16.219.194:37981): tablet 66639234f97f4081bfc203de9774e005 (table test-table [id=1b7d6bd22a3e40b59293527e9392e15e]) successfully deleted
I20260808 13:48:35.293159 17263 tablet_server.cc:179] TabletServer@127.16.219.193:0 shutting down...
I20260808 13:48:35.313791 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 13:48:35.331339 17263 tablet_server.cc:196] TabletServer@127.16.219.193:0 shutdown complete.
I20260808 13:48:35.340790 17263 tablet_server.cc:179] TabletServer@127.16.219.194:0 shutting down...
I20260808 13:48:35.363051 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 13:48:35.379884 17263 tablet_server.cc:196] TabletServer@127.16.219.194:0 shutdown complete.
I20260808 13:48:35.389742 17263 tablet_server.cc:179] TabletServer@127.16.219.195:0 shutting down...
I20260808 13:48:35.408252 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 13:48:35.424649 17263 tablet_server.cc:196] TabletServer@127.16.219.195:0 shutdown complete.
I20260808 13:48:35.434306 17263 master.cc:562] Master@127.16.219.254:34551 shutting down...
I20260808 13:48:35.449469 17263 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1cd925b03f874185b2dcd3af4f02f461 [term 1 LEADER]: Raft consensus shutting down.
I20260808 13:48:35.449930 17263 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1cd925b03f874185b2dcd3af4f02f461 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:35.450275 17263 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1cd925b03f874185b2dcd3af4f02f461: stopping tablet replica
I20260808 13:48:35.468228 17263 master.cc:584] Master@127.16.219.254:34551 shutdown complete.
[ OK ] TsTabletManagerITest.TestDeleteTableDuringTabletCopy (1498 ms)
[----------] 4 tests from TsTabletManagerITest (43912 ms total)
[----------] 4 tests from TxnStatusTabletManagementTest
[ RUN ] TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet
I20260808 13:48:35.493664 17263 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.219.254:41799
I20260808 13:48:35.494774 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:48:35.499737 20771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:35.500823 20772 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:35.503494 20774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:48:35.503625 17263 server_base.cc:1061] running on GCE node
I20260808 13:48:35.504720 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:48:35.504943 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:48:35.505115 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196915505097 us; error 0 us; skew 500 ppm
I20260808 13:48:35.505635 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:48:35.507876 17263 webserver.cc:533] Webserver started at http://127.16.219.254:38983/ using document root <none> and password file <none>
I20260808 13:48:35.508363 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:48:35.508576 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:48:35.508849 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:48:35.509951 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786196858807110-17263-0/minicluster-data/master-0-root/instance:
uuid: "4f19c8ea591746788dc52f364a01e3d4"
format_stamp: "Formatted at 2026-08-08 13:48:35 on dist-test-slave-mn4r"
I20260808 13:48:35.514400 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 13:48:35.517661 20780 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:35.518422 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 13:48:35.518712 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786196858807110-17263-0/minicluster-data/master-0-root
uuid: "4f19c8ea591746788dc52f364a01e3d4"
format_stamp: "Formatted at 2026-08-08 13:48:35 on dist-test-slave-mn4r"
I20260808 13:48:35.519011 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786196858807110-17263-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786196858807110-17263-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786196858807110-17263-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:48:35.543421 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:48:35.544456 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:48:35.581990 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.254:41799
I20260808 13:48:35.582144 20837 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.254:41799 every 8 connection(s)
I20260808 13:48:35.585858 20838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:48:35.595940 20838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f19c8ea591746788dc52f364a01e3d4: Bootstrap starting.
I20260808 13:48:35.600617 20838 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4f19c8ea591746788dc52f364a01e3d4: Neither blocks nor log segments found. Creating new log.
I20260808 13:48:35.604595 20838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f19c8ea591746788dc52f364a01e3d4: No bootstrap required, opened a new log
I20260808 13:48:35.606671 20838 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4f19c8ea591746788dc52f364a01e3d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f19c8ea591746788dc52f364a01e3d4" member_type: VOTER }
I20260808 13:48:35.607065 20838 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4f19c8ea591746788dc52f364a01e3d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:48:35.607311 20838 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4f19c8ea591746788dc52f364a01e3d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f19c8ea591746788dc52f364a01e3d4, State: Initialized, Role: FOLLOWER
I20260808 13:48:35.607932 20838 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f19c8ea591746788dc52f364a01e3d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f19c8ea591746788dc52f364a01e3d4" member_type: VOTER }
I20260808 13:48:35.608407 20838 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4f19c8ea591746788dc52f364a01e3d4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 13:48:35.608639 20838 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4f19c8ea591746788dc52f364a01e3d4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 13:48:35.608904 20838 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4f19c8ea591746788dc52f364a01e3d4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:48:35.613253 20838 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4f19c8ea591746788dc52f364a01e3d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f19c8ea591746788dc52f364a01e3d4" member_type: VOTER }
I20260808 13:48:35.613783 20838 leader_election.cc:304] T 00000000000000000000000000000000 P 4f19c8ea591746788dc52f364a01e3d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4f19c8ea591746788dc52f364a01e3d4; no voters:
I20260808 13:48:35.614944 20838 leader_election.cc:290] T 00000000000000000000000000000000 P 4f19c8ea591746788dc52f364a01e3d4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 13:48:35.615329 20841 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4f19c8ea591746788dc52f364a01e3d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 13:48:35.616689 20841 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4f19c8ea591746788dc52f364a01e3d4 [term 1 LEADER]: Becoming Leader. State: Replica: 4f19c8ea591746788dc52f364a01e3d4, State: Running, Role: LEADER
I20260808 13:48:35.617354 20841 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f19c8ea591746788dc52f364a01e3d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f19c8ea591746788dc52f364a01e3d4" member_type: VOTER }
I20260808 13:48:35.618074 20838 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4f19c8ea591746788dc52f364a01e3d4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 13:48:35.620445 20842 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f19c8ea591746788dc52f364a01e3d4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4f19c8ea591746788dc52f364a01e3d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f19c8ea591746788dc52f364a01e3d4" member_type: VOTER } }
I20260808 13:48:35.620445 20843 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f19c8ea591746788dc52f364a01e3d4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f19c8ea591746788dc52f364a01e3d4. Latest consensus state: current_term: 1 leader_uuid: "4f19c8ea591746788dc52f364a01e3d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f19c8ea591746788dc52f364a01e3d4" member_type: VOTER } }
I20260808 13:48:35.621225 20842 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f19c8ea591746788dc52f364a01e3d4 [sys.catalog]: This master's current role is: LEADER
I20260808 13:48:35.621389 20843 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f19c8ea591746788dc52f364a01e3d4 [sys.catalog]: This master's current role is: LEADER
I20260808 13:48:35.627512 20846 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 13:48:35.634852 20846 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 13:48:35.635888 17263 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260808 13:48:35.643671 20846 catalog_manager.cc:1383] Generated new cluster ID: 8f4c4aad2c27400d96c3c3caf62a933c
I20260808 13:48:35.643973 20846 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 13:48:35.657605 20846 catalog_manager.cc:1406] Generated new certificate authority record
I20260808 13:48:35.658946 20846 catalog_manager.cc:1540] Loading token signing keys...
I20260808 13:48:35.686949 20846 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4f19c8ea591746788dc52f364a01e3d4: Generated new TSK 0
I20260808 13:48:35.687575 20846 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 13:48:35.702795 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:48:35.708384 20861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:35.709586 20862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:35.711154 20865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:48:35.711521 17263 server_base.cc:1061] running on GCE node
I20260808 13:48:35.712289 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:48:35.712492 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:48:35.712668 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196915712633 us; error 0 us; skew 500 ppm
I20260808 13:48:35.713204 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:48:35.715510 17263 webserver.cc:533] Webserver started at http://127.16.219.193:46461/ using document root <none> and password file <none>
I20260808 13:48:35.716017 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:48:35.716207 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:48:35.716488 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:48:35.717558 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786196858807110-17263-0/minicluster-data/ts-0-root/instance:
uuid: "f96bcb834c7b4b4e80512b79b7b0e03a"
format_stamp: "Formatted at 2026-08-08 13:48:35 on dist-test-slave-mn4r"
I20260808 13:48:35.722386 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20260808 13:48:35.725497 20871 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:35.726317 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 13:48:35.726616 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786196858807110-17263-0/minicluster-data/ts-0-root
uuid: "f96bcb834c7b4b4e80512b79b7b0e03a"
format_stamp: "Formatted at 2026-08-08 13:48:35 on dist-test-slave-mn4r"
I20260808 13:48:35.726855 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786196858807110-17263-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786196858807110-17263-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786196858807110-17263-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:48:35.757175 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:48:35.758432 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:48:35.763571 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 13:48:35.763945 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260808 13:48:35.764326 17263 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 13:48:35.764595 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:35.818351 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.193:45739
I20260808 13:48:35.818454 20944 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.193:45739 every 8 connection(s)
I20260808 13:48:35.823513 20946 heartbeater.cc:344] Connected to a master server at 127.16.219.254:41799
I20260808 13:48:35.823879 20946 heartbeater.cc:461] Registering TS with master...
I20260808 13:48:35.824652 20946 heartbeater.cc:507] Master 127.16.219.254:41799 requested a full tablet report, sending...
I20260808 13:48:35.826582 20799 ts_manager.cc:194] Registered new tserver with Master: f96bcb834c7b4b4e80512b79b7b0e03a (127.16.219.193:45739)
I20260808 13:48:35.826781 17263 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.004903981s
I20260808 13:48:35.828581 20799 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40382
I20260808 13:48:35.858599 20907 tablet_service.cc:1511] Processing CreateTablet for tablet 11111111111111111111111111111111 (TXN_STATUS_TABLE table=11111111111111111111111111111111_table_name [id=11111111111111111111111111111111_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20260808 13:48:35.859984 20907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:48:35.872920 20957 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a: Bootstrap starting.
I20260808 13:48:35.877306 20957 tablet_bootstrap.cc:654] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a: Neither blocks nor log segments found. Creating new log.
I20260808 13:48:35.881246 20957 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a: No bootstrap required, opened a new log
I20260808 13:48:35.881572 20957 ts_tablet_manager.cc:1403] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.004s
I20260808 13:48:35.884124 20957 raft_consensus.cc:359] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "f96bcb834c7b4b4e80512b79b7b0e03a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 45739 } }
I20260808 13:48:35.884503 20957 raft_consensus.cc:385] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:48:35.884687 20957 raft_consensus.cc:740] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f96bcb834c7b4b4e80512b79b7b0e03a, State: Initialized, Role: FOLLOWER
I20260808 13:48:35.885136 20957 consensus_queue.cc:260] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "f96bcb834c7b4b4e80512b79b7b0e03a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 45739 } }
I20260808 13:48:35.885556 20957 raft_consensus.cc:399] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 13:48:35.885744 20957 raft_consensus.cc:493] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 13:48:35.885962 20957 raft_consensus.cc:3060] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:48:35.890417 20957 raft_consensus.cc:515] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "f96bcb834c7b4b4e80512b79b7b0e03a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 45739 } }
I20260808 13:48:35.890976 20957 leader_election.cc:304] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f96bcb834c7b4b4e80512b79b7b0e03a; no voters:
I20260808 13:48:35.892128 20957 leader_election.cc:290] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 13:48:35.892513 20959 raft_consensus.cc:2804] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 13:48:35.893926 20959 raft_consensus.cc:697] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a [term 1 LEADER]: Becoming Leader. State: Replica: f96bcb834c7b4b4e80512b79b7b0e03a, State: Running, Role: LEADER
I20260808 13:48:35.894156 20946 heartbeater.cc:499] Master 127.16.219.254:41799 was elected leader, sending a full tablet report...
I20260808 13:48:35.894641 20957 ts_tablet_manager.cc:1434] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a: Time spent starting tablet: real 0.013s user 0.009s sys 0.005s
I20260808 13:48:35.894801 20959 consensus_queue.cc:237] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "f96bcb834c7b4b4e80512b79b7b0e03a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 45739 } }
I20260808 13:48:35.899511 20961 tablet_replica.cc:442] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a: TxnStatusTablet state changed. Reason: New leader f96bcb834c7b4b4e80512b79b7b0e03a. Latest consensus state: current_term: 1 leader_uuid: "f96bcb834c7b4b4e80512b79b7b0e03a" committed_config { opid_index: -1 peers { permanent_uuid: "f96bcb834c7b4b4e80512b79b7b0e03a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 45739 } } }
I20260808 13:48:35.899936 20960 tablet_replica.cc:442] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f96bcb834c7b4b4e80512b79b7b0e03a" committed_config { opid_index: -1 peers { permanent_uuid: "f96bcb834c7b4b4e80512b79b7b0e03a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 45739 } } }
I20260808 13:48:35.900357 20961 tablet_replica.cc:445] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a: This TxnStatusTablet replica's current role is: LEADER
I20260808 13:48:35.900560 20960 tablet_replica.cc:445] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a: This TxnStatusTablet replica's current role is: LEADER
W20260808 13:48:35.902601 20799 catalog_manager.cc:5530] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260808 13:48:35.903650 20964 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260808 13:48:35.904273 20964 txn_status_manager.cc:930] Loading transaction status metadata into memory...
W20260808 13:48:35.907171 20799 catalog_manager.cc:5530] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260808 13:48:35.940002 17263 tablet_server.cc:179] TabletServer@127.16.219.193:0 shutting down...
I20260808 13:48:35.959967 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 13:48:35.960881 17263 tablet_replica.cc:333] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a: stopping tablet replica
I20260808 13:48:35.961396 17263 raft_consensus.cc:2243] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a [term 1 LEADER]: Raft consensus shutting down.
I20260808 13:48:35.961917 17263 raft_consensus.cc:2272] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:35.984165 17263 tablet_server.cc:196] TabletServer@127.16.219.193:0 shutdown complete.
I20260808 13:48:35.996053 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:48:36.002096 20967 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:36.003561 20968 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:48:36.006150 17263 server_base.cc:1061] running on GCE node
W20260808 13:48:36.006914 20970 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:48:36.008152 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:48:36.008425 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:48:36.008636 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196916008620 us; error 0 us; skew 500 ppm
I20260808 13:48:36.009341 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:48:36.012126 17263 webserver.cc:533] Webserver started at http://127.16.219.193:46461/ using document root <none> and password file <none>
I20260808 13:48:36.012763 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:48:36.012985 17263 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260808 13:48:36.017995 17263 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 13:48:36.021597 20975 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:36.022549 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 13:48:36.022891 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786196858807110-17263-0/minicluster-data/ts-0-root
uuid: "f96bcb834c7b4b4e80512b79b7b0e03a"
format_stamp: "Formatted at 2026-08-08 13:48:35 on dist-test-slave-mn4r"
I20260808 13:48:36.023249 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786196858807110-17263-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786196858807110-17263-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet.1786196858807110-17263-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:48:36.045060 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:48:36.046232 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:48:36.054517 20984 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260808 13:48:36.063230 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 13:48:36.063542 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.010s user 0.000s sys 0.002s
I20260808 13:48:36.063877 17263 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260808 13:48:36.070895 17263 ts_tablet_manager.cc:616] Registered 1 tablets
I20260808 13:48:36.071178 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.007s user 0.007s sys 0.001s
I20260808 13:48:36.071244 20984 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a: Bootstrap starting.
I20260808 13:48:36.111867 20984 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 13:48:36.113080 20984 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a: Bootstrap complete.
I20260808 13:48:36.113868 20984 ts_tablet_manager.cc:1403] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a: Time spent bootstrapping tablet: real 0.043s user 0.035s sys 0.005s
I20260808 13:48:36.116665 20984 raft_consensus.cc:359] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "f96bcb834c7b4b4e80512b79b7b0e03a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 45739 } }
I20260808 13:48:36.117229 20984 raft_consensus.cc:740] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f96bcb834c7b4b4e80512b79b7b0e03a, State: Initialized, Role: FOLLOWER
I20260808 13:48:36.118161 20984 consensus_queue.cc:260] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "f96bcb834c7b4b4e80512b79b7b0e03a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 45739 } }
I20260808 13:48:36.118856 20984 raft_consensus.cc:399] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 13:48:36.119234 20984 raft_consensus.cc:493] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 13:48:36.119634 20984 raft_consensus.cc:3060] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a [term 1 FOLLOWER]: Advancing to term 2
I20260808 13:48:36.127259 20984 raft_consensus.cc:515] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "f96bcb834c7b4b4e80512b79b7b0e03a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 45739 } }
I20260808 13:48:36.128096 20984 leader_election.cc:304] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f96bcb834c7b4b4e80512b79b7b0e03a; no voters:
I20260808 13:48:36.129806 20984 leader_election.cc:290] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 13:48:36.130554 21016 raft_consensus.cc:2804] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a [term 2 FOLLOWER]: Leader election won for term 2
I20260808 13:48:36.136341 21016 raft_consensus.cc:697] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a [term 2 LEADER]: Becoming Leader. State: Replica: f96bcb834c7b4b4e80512b79b7b0e03a, State: Running, Role: LEADER
I20260808 13:48:36.137437 21016 consensus_queue.cc:237] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "f96bcb834c7b4b4e80512b79b7b0e03a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 45739 } }
I20260808 13:48:36.140377 20984 ts_tablet_manager.cc:1434] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a: Time spent starting tablet: real 0.026s user 0.017s sys 0.005s
I20260808 13:48:36.154742 21018 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader f96bcb834c7b4b4e80512b79b7b0e03a. Latest consensus state: current_term: 2 leader_uuid: "f96bcb834c7b4b4e80512b79b7b0e03a" committed_config { opid_index: -1 peers { permanent_uuid: "f96bcb834c7b4b4e80512b79b7b0e03a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 45739 } } }
I20260808 13:48:36.155439 21018 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260808 13:48:36.154744 21019 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "f96bcb834c7b4b4e80512b79b7b0e03a" committed_config { opid_index: -1 peers { permanent_uuid: "f96bcb834c7b4b4e80512b79b7b0e03a" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 45739 } } }
I20260808 13:48:36.155821 21019 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260808 13:48:36.156991 21028 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260808 13:48:36.157428 21028 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260808 13:48:36.186667 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.193:45739
I20260808 13:48:36.186751 21058 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.193:45739 every 8 connection(s)
I20260808 13:48:36.193274 21059 heartbeater.cc:344] Connected to a master server at 127.16.219.254:41799
I20260808 13:48:36.193786 21059 heartbeater.cc:461] Registering TS with master...
I20260808 13:48:36.194787 21059 heartbeater.cc:507] Master 127.16.219.254:41799 requested a full tablet report, sending...
I20260808 13:48:36.196112 17263 tablet_server.cc:179] TabletServer@127.16.219.193:45739 shutting down...
I20260808 13:48:36.198478 20799 ts_manager.cc:194] Re-registered known tserver with Master: f96bcb834c7b4b4e80512b79b7b0e03a (127.16.219.193:45739)
W20260808 13:48:36.199142 20799 catalog_manager.cc:5530] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260808 13:48:36.200994 20799 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40416
I20260808 13:48:36.204486 21059 heartbeater.cc:499] Master 127.16.219.254:41799 was elected leader, sending a full tablet report...
W20260808 13:48:36.207810 20799 catalog_manager.cc:5530] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260808 13:48:36.231470 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 13:48:36.232336 17263 tablet_replica.cc:333] stopping tablet replica
I20260808 13:48:36.232947 17263 raft_consensus.cc:2243] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a [term 2 LEADER]: Raft consensus shutting down.
I20260808 13:48:36.233430 17263 raft_consensus.cc:2272] T 11111111111111111111111111111111 P f96bcb834c7b4b4e80512b79b7b0e03a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:36.254927 17263 tablet_server.cc:196] TabletServer@127.16.219.193:45739 shutdown complete.
I20260808 13:48:36.269239 17263 master.cc:562] Master@127.16.219.254:41799 shutting down...
I20260808 13:48:36.287364 17263 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4f19c8ea591746788dc52f364a01e3d4 [term 1 LEADER]: Raft consensus shutting down.
I20260808 13:48:36.287937 17263 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4f19c8ea591746788dc52f364a01e3d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:36.288266 17263 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4f19c8ea591746788dc52f364a01e3d4: stopping tablet replica
I20260808 13:48:36.307003 17263 master.cc:584] Master@127.16.219.254:41799 shutdown complete.
[ OK ] TxnStatusTabletManagementTest.TestBootstrapTransactionStatusTablet (837 ms)
[ RUN ] TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet
I20260808 13:48:36.331357 17263 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.219.254:41169
I20260808 13:48:36.332455 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:48:36.338964 21067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:36.337886 21066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:36.342000 21069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:48:36.342871 17263 server_base.cc:1061] running on GCE node
I20260808 13:48:36.343634 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:48:36.343894 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:48:36.344069 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196916344055 us; error 0 us; skew 500 ppm
I20260808 13:48:36.344681 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:48:36.347559 17263 webserver.cc:533] Webserver started at http://127.16.219.254:38073/ using document root <none> and password file <none>
I20260808 13:48:36.348044 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:48:36.348227 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:48:36.348490 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:48:36.349592 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786196858807110-17263-0/minicluster-data/master-0-root/instance:
uuid: "5421e69be77446dda5e5af6d4e978d3c"
format_stamp: "Formatted at 2026-08-08 13:48:36 on dist-test-slave-mn4r"
I20260808 13:48:36.354440 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260808 13:48:36.357980 21074 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:36.358865 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.002s
I20260808 13:48:36.359160 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786196858807110-17263-0/minicluster-data/master-0-root
uuid: "5421e69be77446dda5e5af6d4e978d3c"
format_stamp: "Formatted at 2026-08-08 13:48:36 on dist-test-slave-mn4r"
I20260808 13:48:36.359421 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786196858807110-17263-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786196858807110-17263-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786196858807110-17263-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:48:36.379742 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:48:36.380756 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:48:36.431567 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.254:41169
I20260808 13:48:36.431731 21128 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.254:41169 every 8 connection(s)
I20260808 13:48:36.435849 21129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:48:36.445933 21129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5421e69be77446dda5e5af6d4e978d3c: Bootstrap starting.
I20260808 13:48:36.450356 21129 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5421e69be77446dda5e5af6d4e978d3c: Neither blocks nor log segments found. Creating new log.
I20260808 13:48:36.454619 21129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5421e69be77446dda5e5af6d4e978d3c: No bootstrap required, opened a new log
I20260808 13:48:36.456604 21129 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5421e69be77446dda5e5af6d4e978d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5421e69be77446dda5e5af6d4e978d3c" member_type: VOTER }
I20260808 13:48:36.457010 21129 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5421e69be77446dda5e5af6d4e978d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:48:36.457235 21129 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5421e69be77446dda5e5af6d4e978d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5421e69be77446dda5e5af6d4e978d3c, State: Initialized, Role: FOLLOWER
I20260808 13:48:36.457861 21129 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5421e69be77446dda5e5af6d4e978d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5421e69be77446dda5e5af6d4e978d3c" member_type: VOTER }
I20260808 13:48:36.458391 21129 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5421e69be77446dda5e5af6d4e978d3c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 13:48:36.458647 21129 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5421e69be77446dda5e5af6d4e978d3c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 13:48:36.458920 21129 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5421e69be77446dda5e5af6d4e978d3c [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:48:36.463526 21129 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5421e69be77446dda5e5af6d4e978d3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5421e69be77446dda5e5af6d4e978d3c" member_type: VOTER }
I20260808 13:48:36.464008 21129 leader_election.cc:304] T 00000000000000000000000000000000 P 5421e69be77446dda5e5af6d4e978d3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5421e69be77446dda5e5af6d4e978d3c; no voters:
I20260808 13:48:36.465329 21129 leader_election.cc:290] T 00000000000000000000000000000000 P 5421e69be77446dda5e5af6d4e978d3c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 13:48:36.465667 21133 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5421e69be77446dda5e5af6d4e978d3c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 13:48:36.467397 21133 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5421e69be77446dda5e5af6d4e978d3c [term 1 LEADER]: Becoming Leader. State: Replica: 5421e69be77446dda5e5af6d4e978d3c, State: Running, Role: LEADER
I20260808 13:48:36.468183 21133 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5421e69be77446dda5e5af6d4e978d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5421e69be77446dda5e5af6d4e978d3c" member_type: VOTER }
I20260808 13:48:36.468847 21129 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5421e69be77446dda5e5af6d4e978d3c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 13:48:36.471055 21134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5421e69be77446dda5e5af6d4e978d3c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5421e69be77446dda5e5af6d4e978d3c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5421e69be77446dda5e5af6d4e978d3c" member_type: VOTER } }
I20260808 13:48:36.471566 21134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5421e69be77446dda5e5af6d4e978d3c [sys.catalog]: This master's current role is: LEADER
I20260808 13:48:36.473336 21135 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5421e69be77446dda5e5af6d4e978d3c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5421e69be77446dda5e5af6d4e978d3c. Latest consensus state: current_term: 1 leader_uuid: "5421e69be77446dda5e5af6d4e978d3c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5421e69be77446dda5e5af6d4e978d3c" member_type: VOTER } }
I20260808 13:48:36.473995 21135 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5421e69be77446dda5e5af6d4e978d3c [sys.catalog]: This master's current role is: LEADER
I20260808 13:48:36.492458 21138 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 13:48:36.499521 21138 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 13:48:36.504341 17263 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260808 13:48:36.510206 21138 catalog_manager.cc:1383] Generated new cluster ID: 0c48196189014b73a3b11f5a47bcc3a5
I20260808 13:48:36.510488 21138 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 13:48:36.563046 21138 catalog_manager.cc:1406] Generated new certificate authority record
I20260808 13:48:36.564723 21138 catalog_manager.cc:1540] Loading token signing keys...
I20260808 13:48:36.588208 21138 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5421e69be77446dda5e5af6d4e978d3c: Generated new TSK 0
I20260808 13:48:36.588888 21138 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 13:48:36.635934 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:48:36.642442 21152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:36.644016 21153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:48:36.651522 17263 server_base.cc:1061] running on GCE node
W20260808 13:48:36.651489 21155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:48:36.652684 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:48:36.652871 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:48:36.652997 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196916652985 us; error 0 us; skew 500 ppm
I20260808 13:48:36.653473 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:48:36.656374 17263 webserver.cc:533] Webserver started at http://127.16.219.193:44875/ using document root <none> and password file <none>
I20260808 13:48:36.656873 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:48:36.657090 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:48:36.657372 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:48:36.658567 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786196858807110-17263-0/minicluster-data/ts-0-root/instance:
uuid: "bff2e7758d154c6d8c5c82ccbfd527d3"
format_stamp: "Formatted at 2026-08-08 13:48:36 on dist-test-slave-mn4r"
I20260808 13:48:36.663501 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 13:48:36.667127 21161 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:36.668026 17263 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 13:48:36.668300 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786196858807110-17263-0/minicluster-data/ts-0-root
uuid: "bff2e7758d154c6d8c5c82ccbfd527d3"
format_stamp: "Formatted at 2026-08-08 13:48:36 on dist-test-slave-mn4r"
I20260808 13:48:36.668542 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786196858807110-17263-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786196858807110-17263-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786196858807110-17263-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:48:36.684017 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:48:36.685029 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:48:36.698242 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 13:48:36.698709 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:36.699152 17263 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 13:48:36.699460 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:36.776964 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.193:42793
I20260808 13:48:36.777091 21236 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.193:42793 every 8 connection(s)
I20260808 13:48:36.782167 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260808 13:48:36.782346 21237 heartbeater.cc:344] Connected to a master server at 127.16.219.254:41169
I20260808 13:48:36.782791 21237 heartbeater.cc:461] Registering TS with master...
I20260808 13:48:36.783682 21237 heartbeater.cc:507] Master 127.16.219.254:41169 requested a full tablet report, sending...
I20260808 13:48:36.786020 21092 ts_manager.cc:194] Registered new tserver with Master: bff2e7758d154c6d8c5c82ccbfd527d3 (127.16.219.193:42793)
I20260808 13:48:36.788965 21092 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39298
W20260808 13:48:36.788983 21239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:36.790393 21240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:48:36.797165 17263 server_base.cc:1061] running on GCE node
W20260808 13:48:36.798131 21242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:48:36.799015 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:48:36.799244 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:48:36.799423 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196916799407 us; error 0 us; skew 500 ppm
I20260808 13:48:36.799940 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:48:36.802632 17263 webserver.cc:533] Webserver started at http://127.16.219.194:34927/ using document root <none> and password file <none>
I20260808 13:48:36.803153 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:48:36.803362 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:48:36.803632 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:48:36.804708 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786196858807110-17263-0/minicluster-data/ts-1-root/instance:
uuid: "698e826c5cb440a6a4e9bd82f5119082"
format_stamp: "Formatted at 2026-08-08 13:48:36 on dist-test-slave-mn4r"
I20260808 13:48:36.809368 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 13:48:36.813004 21247 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:36.813872 17263 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 13:48:36.814188 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786196858807110-17263-0/minicluster-data/ts-1-root
uuid: "698e826c5cb440a6a4e9bd82f5119082"
format_stamp: "Formatted at 2026-08-08 13:48:36 on dist-test-slave-mn4r"
I20260808 13:48:36.814438 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786196858807110-17263-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786196858807110-17263-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786196858807110-17263-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:48:36.831174 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:48:36.832389 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:48:36.839864 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 13:48:36.840171 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:36.840472 17263 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 13:48:36.840768 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260808 13:48:36.905726 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.194:33147
I20260808 13:48:36.905815 21321 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.194:33147 every 8 connection(s)
I20260808 13:48:36.911808 21322 heartbeater.cc:344] Connected to a master server at 127.16.219.254:41169
I20260808 13:48:36.912204 21322 heartbeater.cc:461] Registering TS with master...
I20260808 13:48:36.912928 21322 heartbeater.cc:507] Master 127.16.219.254:41169 requested a full tablet report, sending...
I20260808 13:48:36.914913 21092 ts_manager.cc:194] Registered new tserver with Master: 698e826c5cb440a6a4e9bd82f5119082 (127.16.219.194:33147)
I20260808 13:48:36.915383 17263 internal_mini_cluster.cc:371] 2 TS(s) registered with all masters after 0.005321595s
I20260808 13:48:36.916600 21092 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39304
I20260808 13:48:36.952922 21198 tablet_service.cc:1511] Processing CreateTablet for tablet 11111111111111111111111111111111 (TXN_STATUS_TABLE table=11111111111111111111111111111111_table_name [id=11111111111111111111111111111111_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20260808 13:48:36.954520 21198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:48:36.970374 21332 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3: Bootstrap starting.
I20260808 13:48:36.975117 21332 tablet_bootstrap.cc:654] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3: Neither blocks nor log segments found. Creating new log.
I20260808 13:48:36.979450 21332 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3: No bootstrap required, opened a new log
I20260808 13:48:36.979853 21332 ts_tablet_manager.cc:1403] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260808 13:48:36.981842 21332 raft_consensus.cc:359] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "bff2e7758d154c6d8c5c82ccbfd527d3" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 42793 } }
I20260808 13:48:36.982340 21332 raft_consensus.cc:385] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:48:36.982586 21332 raft_consensus.cc:740] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bff2e7758d154c6d8c5c82ccbfd527d3, State: Initialized, Role: FOLLOWER
I20260808 13:48:36.983178 21332 consensus_queue.cc:260] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "bff2e7758d154c6d8c5c82ccbfd527d3" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 42793 } }
I20260808 13:48:36.983661 21332 raft_consensus.cc:399] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 13:48:36.983907 21332 raft_consensus.cc:493] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 13:48:36.984167 21332 raft_consensus.cc:3060] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:48:36.988584 21332 raft_consensus.cc:515] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "bff2e7758d154c6d8c5c82ccbfd527d3" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 42793 } }
I20260808 13:48:36.989269 21332 leader_election.cc:304] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bff2e7758d154c6d8c5c82ccbfd527d3; no voters:
I20260808 13:48:36.990703 21332 leader_election.cc:290] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 13:48:36.991060 21334 raft_consensus.cc:2804] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 13:48:36.993422 21237 heartbeater.cc:499] Master 127.16.219.254:41169 was elected leader, sending a full tablet report...
I20260808 13:48:36.994400 21332 ts_tablet_manager.cc:1434] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3: Time spent starting tablet: real 0.014s user 0.016s sys 0.000s
I20260808 13:48:36.994640 21334 raft_consensus.cc:697] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3 [term 1 LEADER]: Becoming Leader. State: Replica: bff2e7758d154c6d8c5c82ccbfd527d3, State: Running, Role: LEADER
I20260808 13:48:36.995406 21334 consensus_queue.cc:237] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "bff2e7758d154c6d8c5c82ccbfd527d3" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 42793 } }
I20260808 13:48:36.998422 21335 tablet_replica.cc:442] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bff2e7758d154c6d8c5c82ccbfd527d3" committed_config { opid_index: -1 peers { permanent_uuid: "bff2e7758d154c6d8c5c82ccbfd527d3" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 42793 } } }
I20260808 13:48:36.998945 21335 tablet_replica.cc:445] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3: This TxnStatusTablet replica's current role is: LEADER
W20260808 13:48:37.001020 21092 catalog_manager.cc:5530] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260808 13:48:37.000888 21336 tablet_replica.cc:442] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3: TxnStatusTablet state changed. Reason: New leader bff2e7758d154c6d8c5c82ccbfd527d3. Latest consensus state: current_term: 1 leader_uuid: "bff2e7758d154c6d8c5c82ccbfd527d3" committed_config { opid_index: -1 peers { permanent_uuid: "bff2e7758d154c6d8c5c82ccbfd527d3" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 42793 } } }
I20260808 13:48:37.001617 21336 tablet_replica.cc:445] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3: This TxnStatusTablet replica's current role is: LEADER
I20260808 13:48:37.011426 21340 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260808 13:48:37.011754 21340 txn_status_manager.cc:930] Loading transaction status metadata into memory...
W20260808 13:48:37.013216 21092 catalog_manager.cc:5530] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260808 13:48:37.064976 21346 ts_tablet_manager.cc:933] T 11111111111111111111111111111111 P 698e826c5cb440a6a4e9bd82f5119082: Initiating tablet copy from peer bff2e7758d154c6d8c5c82ccbfd527d3 (127.16.219.193:42793)
I20260808 13:48:37.066908 21346 tablet_copy_client.cc:323] T 11111111111111111111111111111111 P 698e826c5cb440a6a4e9bd82f5119082: tablet copy: Beginning tablet copy session from remote peer at address 127.16.219.193:42793
I20260808 13:48:37.076004 21218 tablet_copy_service.cc:140] P bff2e7758d154c6d8c5c82ccbfd527d3: Received BeginTabletCopySession request for tablet 11111111111111111111111111111111 from peer 698e826c5cb440a6a4e9bd82f5119082 ({username='slave'} at 127.0.0.1:47192)
I20260808 13:48:37.076582 21218 tablet_copy_service.cc:161] P bff2e7758d154c6d8c5c82ccbfd527d3: Beginning new tablet copy session on tablet 11111111111111111111111111111111 from peer 698e826c5cb440a6a4e9bd82f5119082 at {username='slave'} at 127.0.0.1:47192: session id = 698e826c5cb440a6a4e9bd82f5119082-11111111111111111111111111111111
I20260808 13:48:37.084187 21218 tablet_copy_source_session.cc:215] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 13:48:37.087277 21346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:48:37.098309 21346 tablet_copy_client.cc:806] T 11111111111111111111111111111111 P 698e826c5cb440a6a4e9bd82f5119082: tablet copy: Starting download of 0 data blocks...
I20260808 13:48:37.098839 21346 tablet_copy_client.cc:670] T 11111111111111111111111111111111 P 698e826c5cb440a6a4e9bd82f5119082: tablet copy: Starting download of 1 WAL segments...
I20260808 13:48:37.102626 21346 tablet_copy_client.cc:538] T 11111111111111111111111111111111 P 698e826c5cb440a6a4e9bd82f5119082: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 13:48:37.110509 21346 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 698e826c5cb440a6a4e9bd82f5119082: Bootstrap starting.
I20260808 13:48:37.133363 21346 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 698e826c5cb440a6a4e9bd82f5119082: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 13:48:37.134202 21346 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 698e826c5cb440a6a4e9bd82f5119082: Bootstrap complete.
I20260808 13:48:37.134768 21346 ts_tablet_manager.cc:1403] T 11111111111111111111111111111111 P 698e826c5cb440a6a4e9bd82f5119082: Time spent bootstrapping tablet: real 0.024s user 0.015s sys 0.009s
I20260808 13:48:37.136927 21346 raft_consensus.cc:359] T 11111111111111111111111111111111 P 698e826c5cb440a6a4e9bd82f5119082 [term 1 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "bff2e7758d154c6d8c5c82ccbfd527d3" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 42793 } }
I20260808 13:48:37.137346 21346 raft_consensus.cc:740] T 11111111111111111111111111111111 P 698e826c5cb440a6a4e9bd82f5119082 [term 1 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 698e826c5cb440a6a4e9bd82f5119082, State: Initialized, Role: NON_PARTICIPANT
I20260808 13:48:37.137885 21346 consensus_queue.cc:260] T 11111111111111111111111111111111 P 698e826c5cb440a6a4e9bd82f5119082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "bff2e7758d154c6d8c5c82ccbfd527d3" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 42793 } }
I20260808 13:48:37.139828 21349 tablet_replica.cc:442] T 11111111111111111111111111111111 P 698e826c5cb440a6a4e9bd82f5119082: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 peers { permanent_uuid: "bff2e7758d154c6d8c5c82ccbfd527d3" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 42793 } } }
I20260808 13:48:37.140043 21322 heartbeater.cc:499] Master 127.16.219.254:41169 was elected leader, sending a full tablet report...
I20260808 13:48:37.140290 21346 ts_tablet_manager.cc:1434] T 11111111111111111111111111111111 P 698e826c5cb440a6a4e9bd82f5119082: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 13:48:37.140442 21349 tablet_replica.cc:445] T 11111111111111111111111111111111 P 698e826c5cb440a6a4e9bd82f5119082: This TxnStatusTablet replica's current role is: NON_PARTICIPANT
I20260808 13:48:37.142234 21218 tablet_copy_service.cc:342] P bff2e7758d154c6d8c5c82ccbfd527d3: Request end of tablet copy session 698e826c5cb440a6a4e9bd82f5119082-11111111111111111111111111111111 received from {username='slave'} at 127.0.0.1:47192
I20260808 13:48:37.142632 21218 tablet_copy_service.cc:434] P bff2e7758d154c6d8c5c82ccbfd527d3: ending tablet copy session 698e826c5cb440a6a4e9bd82f5119082-11111111111111111111111111111111 on tablet 11111111111111111111111111111111 with peer 698e826c5cb440a6a4e9bd82f5119082
W20260808 13:48:37.143245 21092 catalog_manager.cc:5530] Ignoring report from unknown tablet 11111111111111111111111111111111
W20260808 13:48:37.147758 21092 catalog_manager.cc:5530] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260808 13:48:37.163403 17263 tablet_server.cc:179] TabletServer@127.16.219.193:0 shutting down...
I20260808 13:48:37.186514 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 13:48:37.187399 17263 tablet_replica.cc:333] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3: stopping tablet replica
I20260808 13:48:37.188052 17263 raft_consensus.cc:2243] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3 [term 1 LEADER]: Raft consensus shutting down.
I20260808 13:48:37.188563 17263 raft_consensus.cc:2272] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:37.211202 17263 tablet_server.cc:196] TabletServer@127.16.219.193:0 shutdown complete.
I20260808 13:48:37.223362 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:48:37.229578 21350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:37.231475 21351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:37.232996 21353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:48:37.234045 17263 server_base.cc:1061] running on GCE node
I20260808 13:48:37.235131 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:48:37.235375 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:48:37.235625 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196917235606 us; error 0 us; skew 500 ppm
I20260808 13:48:37.236212 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:48:37.239166 17263 webserver.cc:533] Webserver started at http://127.16.219.193:44875/ using document root <none> and password file <none>
I20260808 13:48:37.239665 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:48:37.239850 17263 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260808 13:48:37.243736 17263 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 13:48:37.246819 21359 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:37.247707 17263 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 13:48:37.247997 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786196858807110-17263-0/minicluster-data/ts-0-root
uuid: "bff2e7758d154c6d8c5c82ccbfd527d3"
format_stamp: "Formatted at 2026-08-08 13:48:36 on dist-test-slave-mn4r"
I20260808 13:48:37.248282 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786196858807110-17263-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786196858807110-17263-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet.1786196858807110-17263-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:48:37.261454 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:48:37.262554 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:48:37.271557 21368 ts_tablet_manager.cc:548] Loading tablet metadata (0/1 complete)
I20260808 13:48:37.279409 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 13:48:37.279713 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.009s user 0.001s sys 0.000s
I20260808 13:48:37.280031 17263 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260808 13:48:37.284958 17263 ts_tablet_manager.cc:616] Registered 1 tablets
I20260808 13:48:37.285192 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.005s user 0.003s sys 0.000s
I20260808 13:48:37.285303 21368 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3: Bootstrap starting.
I20260808 13:48:37.329035 21368 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 13:48:37.330188 21368 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3: Bootstrap complete.
I20260808 13:48:37.330919 21368 ts_tablet_manager.cc:1403] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3: Time spent bootstrapping tablet: real 0.046s user 0.037s sys 0.004s
I20260808 13:48:37.333796 21368 raft_consensus.cc:359] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "bff2e7758d154c6d8c5c82ccbfd527d3" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 42793 } }
I20260808 13:48:37.334486 21368 raft_consensus.cc:740] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bff2e7758d154c6d8c5c82ccbfd527d3, State: Initialized, Role: FOLLOWER
I20260808 13:48:37.335341 21368 consensus_queue.cc:260] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "bff2e7758d154c6d8c5c82ccbfd527d3" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 42793 } }
I20260808 13:48:37.336076 21368 raft_consensus.cc:399] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 13:48:37.336436 21368 raft_consensus.cc:493] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 13:48:37.336810 21368 raft_consensus.cc:3060] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3 [term 1 FOLLOWER]: Advancing to term 2
I20260808 13:48:37.354750 21368 raft_consensus.cc:515] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "bff2e7758d154c6d8c5c82ccbfd527d3" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 42793 } }
I20260808 13:48:37.355556 21368 leader_election.cc:304] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bff2e7758d154c6d8c5c82ccbfd527d3; no voters:
I20260808 13:48:37.357065 21368 leader_election.cc:290] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 13:48:37.357641 21383 raft_consensus.cc:2804] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 13:48:37.362639 21368 ts_tablet_manager.cc:1434] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3: Time spent starting tablet: real 0.031s user 0.019s sys 0.000s
I20260808 13:48:37.364791 21383 raft_consensus.cc:697] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3 [term 2 LEADER]: Becoming Leader. State: Replica: bff2e7758d154c6d8c5c82ccbfd527d3, State: Running, Role: LEADER
I20260808 13:48:37.365945 21383 consensus_queue.cc:237] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "bff2e7758d154c6d8c5c82ccbfd527d3" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 42793 } }
I20260808 13:48:37.370652 21385 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "bff2e7758d154c6d8c5c82ccbfd527d3" committed_config { opid_index: -1 peers { permanent_uuid: "bff2e7758d154c6d8c5c82ccbfd527d3" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 42793 } } }
I20260808 13:48:37.371333 21385 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260808 13:48:37.373211 21386 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader bff2e7758d154c6d8c5c82ccbfd527d3. Latest consensus state: current_term: 2 leader_uuid: "bff2e7758d154c6d8c5c82ccbfd527d3" committed_config { opid_index: -1 peers { permanent_uuid: "bff2e7758d154c6d8c5c82ccbfd527d3" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 42793 } } }
I20260808 13:48:37.373854 21386 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260808 13:48:37.387900 21393 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260808 13:48:37.388511 21393 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260808 13:48:37.426374 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.193:42793
I20260808 13:48:37.426468 21441 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.193:42793 every 8 connection(s)
I20260808 13:48:37.433298 21442 heartbeater.cc:344] Connected to a master server at 127.16.219.254:41169
I20260808 13:48:37.433766 21442 heartbeater.cc:461] Registering TS with master...
I20260808 13:48:37.434818 21442 heartbeater.cc:507] Master 127.16.219.254:41169 requested a full tablet report, sending...
I20260808 13:48:37.437103 17263 tablet_server.cc:179] TabletServer@127.16.219.193:42793 shutting down...
I20260808 13:48:37.438103 21092 ts_manager.cc:194] Re-registered known tserver with Master: bff2e7758d154c6d8c5c82ccbfd527d3 (127.16.219.193:42793)
W20260808 13:48:37.439234 21092 catalog_manager.cc:5530] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260808 13:48:37.440992 21092 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39338
I20260808 13:48:37.445789 21442 heartbeater.cc:499] Master 127.16.219.254:41169 was elected leader, sending a full tablet report...
W20260808 13:48:37.451545 21092 catalog_manager.cc:5530] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260808 13:48:37.466838 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 13:48:37.467757 17263 tablet_replica.cc:333] stopping tablet replica
I20260808 13:48:37.468451 17263 raft_consensus.cc:2243] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3 [term 2 LEADER]: Raft consensus shutting down.
I20260808 13:48:37.469010 17263 raft_consensus.cc:2272] T 11111111111111111111111111111111 P bff2e7758d154c6d8c5c82ccbfd527d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:37.481494 17263 tablet_server.cc:196] TabletServer@127.16.219.193:42793 shutdown complete.
I20260808 13:48:37.496258 17263 tablet_server.cc:179] TabletServer@127.16.219.194:0 shutting down...
I20260808 13:48:37.523885 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 13:48:37.524804 17263 tablet_replica.cc:333] T 11111111111111111111111111111111 P 698e826c5cb440a6a4e9bd82f5119082: stopping tablet replica
I20260808 13:48:37.525313 17263 raft_consensus.cc:2243] T 11111111111111111111111111111111 P 698e826c5cb440a6a4e9bd82f5119082 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260808 13:48:37.525725 17263 raft_consensus.cc:2272] T 11111111111111111111111111111111 P 698e826c5cb440a6a4e9bd82f5119082 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260808 13:48:37.545389 17263 tablet_server.cc:196] TabletServer@127.16.219.194:0 shutdown complete.
I20260808 13:48:37.557289 17263 master.cc:562] Master@127.16.219.254:41169 shutting down...
I20260808 13:48:37.575919 17263 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5421e69be77446dda5e5af6d4e978d3c [term 1 LEADER]: Raft consensus shutting down.
I20260808 13:48:37.576527 17263 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5421e69be77446dda5e5af6d4e978d3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:37.576861 17263 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5421e69be77446dda5e5af6d4e978d3c: stopping tablet replica
I20260808 13:48:37.597038 17263 master.cc:584] Master@127.16.219.254:41169 shutdown complete.
[ OK ] TxnStatusTabletManagementTest.TestCopyTransactionStatusTablet (1292 ms)
[ RUN ] TxnStatusTabletManagementTest.TestTabletServerProxyCalls
I20260808 13:48:37.624024 17263 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.219.254:39721
I20260808 13:48:37.625137 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:48:37.630736 21449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:37.632244 21450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:37.634913 21453 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:48:37.635318 17263 server_base.cc:1061] running on GCE node
I20260808 13:48:37.636296 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:48:37.636495 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:48:37.636686 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196917636673 us; error 0 us; skew 500 ppm
I20260808 13:48:37.637295 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:48:37.640544 17263 webserver.cc:533] Webserver started at http://127.16.219.254:35979/ using document root <none> and password file <none>
I20260808 13:48:37.641067 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:48:37.641263 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:48:37.641574 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:48:37.642787 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786196858807110-17263-0/minicluster-data/master-0-root/instance:
uuid: "54f718b0ea1342008b50deff57d717a5"
format_stamp: "Formatted at 2026-08-08 13:48:37 on dist-test-slave-mn4r"
I20260808 13:48:37.647717 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 13:48:37.651573 21461 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:37.652485 17263 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260808 13:48:37.652827 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786196858807110-17263-0/minicluster-data/master-0-root
uuid: "54f718b0ea1342008b50deff57d717a5"
format_stamp: "Formatted at 2026-08-08 13:48:37 on dist-test-slave-mn4r"
I20260808 13:48:37.653182 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786196858807110-17263-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786196858807110-17263-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786196858807110-17263-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:48:37.672159 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:48:37.673566 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:48:37.727792 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.254:39721
I20260808 13:48:37.727885 21517 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.254:39721 every 8 connection(s)
I20260808 13:48:37.732218 21519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:48:37.742489 21519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54f718b0ea1342008b50deff57d717a5: Bootstrap starting.
I20260808 13:48:37.746871 21519 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 54f718b0ea1342008b50deff57d717a5: Neither blocks nor log segments found. Creating new log.
I20260808 13:48:37.751103 21519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54f718b0ea1342008b50deff57d717a5: No bootstrap required, opened a new log
I20260808 13:48:37.753111 21519 raft_consensus.cc:359] T 00000000000000000000000000000000 P 54f718b0ea1342008b50deff57d717a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54f718b0ea1342008b50deff57d717a5" member_type: VOTER }
I20260808 13:48:37.753461 21519 raft_consensus.cc:385] T 00000000000000000000000000000000 P 54f718b0ea1342008b50deff57d717a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:48:37.753726 21519 raft_consensus.cc:740] T 00000000000000000000000000000000 P 54f718b0ea1342008b50deff57d717a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f718b0ea1342008b50deff57d717a5, State: Initialized, Role: FOLLOWER
I20260808 13:48:37.754434 21519 consensus_queue.cc:260] T 00000000000000000000000000000000 P 54f718b0ea1342008b50deff57d717a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54f718b0ea1342008b50deff57d717a5" member_type: VOTER }
I20260808 13:48:37.754875 21519 raft_consensus.cc:399] T 00000000000000000000000000000000 P 54f718b0ea1342008b50deff57d717a5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 13:48:37.755112 21519 raft_consensus.cc:493] T 00000000000000000000000000000000 P 54f718b0ea1342008b50deff57d717a5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 13:48:37.755417 21519 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 54f718b0ea1342008b50deff57d717a5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:48:37.759794 21519 raft_consensus.cc:515] T 00000000000000000000000000000000 P 54f718b0ea1342008b50deff57d717a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54f718b0ea1342008b50deff57d717a5" member_type: VOTER }
I20260808 13:48:37.760291 21519 leader_election.cc:304] T 00000000000000000000000000000000 P 54f718b0ea1342008b50deff57d717a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 54f718b0ea1342008b50deff57d717a5; no voters:
I20260808 13:48:37.761524 21519 leader_election.cc:290] T 00000000000000000000000000000000 P 54f718b0ea1342008b50deff57d717a5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 13:48:37.761976 21522 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 54f718b0ea1342008b50deff57d717a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 13:48:37.763677 21522 raft_consensus.cc:697] T 00000000000000000000000000000000 P 54f718b0ea1342008b50deff57d717a5 [term 1 LEADER]: Becoming Leader. State: Replica: 54f718b0ea1342008b50deff57d717a5, State: Running, Role: LEADER
I20260808 13:48:37.764384 21522 consensus_queue.cc:237] T 00000000000000000000000000000000 P 54f718b0ea1342008b50deff57d717a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54f718b0ea1342008b50deff57d717a5" member_type: VOTER }
I20260808 13:48:37.764753 21519 sys_catalog.cc:565] T 00000000000000000000000000000000 P 54f718b0ea1342008b50deff57d717a5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 13:48:37.768136 21523 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54f718b0ea1342008b50deff57d717a5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "54f718b0ea1342008b50deff57d717a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54f718b0ea1342008b50deff57d717a5" member_type: VOTER } }
I20260808 13:48:37.768610 21524 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54f718b0ea1342008b50deff57d717a5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54f718b0ea1342008b50deff57d717a5. Latest consensus state: current_term: 1 leader_uuid: "54f718b0ea1342008b50deff57d717a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54f718b0ea1342008b50deff57d717a5" member_type: VOTER } }
I20260808 13:48:37.769385 21524 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54f718b0ea1342008b50deff57d717a5 [sys.catalog]: This master's current role is: LEADER
I20260808 13:48:37.768646 21523 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54f718b0ea1342008b50deff57d717a5 [sys.catalog]: This master's current role is: LEADER
I20260808 13:48:37.777256 21527 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 13:48:37.784246 21527 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 13:48:37.787199 17263 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260808 13:48:37.794641 21527 catalog_manager.cc:1383] Generated new cluster ID: 68c0ec9134c9466591a8b3bcfe7213b1
I20260808 13:48:37.794895 21527 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 13:48:37.836735 21527 catalog_manager.cc:1406] Generated new certificate authority record
I20260808 13:48:37.838021 21527 catalog_manager.cc:1540] Loading token signing keys...
I20260808 13:48:37.857414 21527 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 54f718b0ea1342008b50deff57d717a5: Generated new TSK 0
I20260808 13:48:37.858153 21527 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 13:48:37.918349 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:48:37.925906 21542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:37.927806 21543 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:37.929493 21545 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:48:37.930524 17263 server_base.cc:1061] running on GCE node
I20260808 13:48:37.931598 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:48:37.931829 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:48:37.932063 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196917932016 us; error 0 us; skew 500 ppm
I20260808 13:48:37.932693 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:48:37.935915 17263 webserver.cc:533] Webserver started at http://127.16.219.193:37585/ using document root <none> and password file <none>
I20260808 13:48:37.936609 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:48:37.936889 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:48:37.937288 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:48:37.938651 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786196858807110-17263-0/minicluster-data/ts-0-root/instance:
uuid: "bb3c5ad8b3754fa683d2c5eba78653c2"
format_stamp: "Formatted at 2026-08-08 13:48:37 on dist-test-slave-mn4r"
I20260808 13:48:37.944247 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 13:48:37.948448 21550 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:37.949505 17263 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 13:48:37.949836 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786196858807110-17263-0/minicluster-data/ts-0-root
uuid: "bb3c5ad8b3754fa683d2c5eba78653c2"
format_stamp: "Formatted at 2026-08-08 13:48:37 on dist-test-slave-mn4r"
I20260808 13:48:37.950238 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786196858807110-17263-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786196858807110-17263-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCalls.1786196858807110-17263-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:48:37.990833 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:48:37.991995 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:48:38.004843 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 13:48:38.005280 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:38.005664 17263 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 13:48:38.005954 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:38.093814 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.193:39781
I20260808 13:48:38.093930 21627 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.193:39781 every 8 connection(s)
I20260808 13:48:38.100304 21628 heartbeater.cc:344] Connected to a master server at 127.16.219.254:39721
I20260808 13:48:38.100729 21628 heartbeater.cc:461] Registering TS with master...
I20260808 13:48:38.101544 21628 heartbeater.cc:507] Master 127.16.219.254:39721 requested a full tablet report, sending...
I20260808 13:48:38.103888 21481 ts_manager.cc:194] Registered new tserver with Master: bb3c5ad8b3754fa683d2c5eba78653c2 (127.16.219.193:39781)
I20260808 13:48:38.104648 17263 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.006193588s
I20260808 13:48:38.105770 21481 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52344
I20260808 13:48:38.144291 21588 tablet_service.cc:1511] Processing CreateTablet for tablet 11111111111111111111111111111111 (TXN_STATUS_TABLE table=11111111111111111111111111111111_table_name [id=11111111111111111111111111111111_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20260808 13:48:38.145539 21588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:48:38.157791 21638 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P bb3c5ad8b3754fa683d2c5eba78653c2: Bootstrap starting.
I20260808 13:48:38.163712 21638 tablet_bootstrap.cc:654] T 11111111111111111111111111111111 P bb3c5ad8b3754fa683d2c5eba78653c2: Neither blocks nor log segments found. Creating new log.
I20260808 13:48:38.168556 21638 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P bb3c5ad8b3754fa683d2c5eba78653c2: No bootstrap required, opened a new log
I20260808 13:48:38.169013 21638 ts_tablet_manager.cc:1403] T 11111111111111111111111111111111 P bb3c5ad8b3754fa683d2c5eba78653c2: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.003s
I20260808 13:48:38.171556 21638 raft_consensus.cc:359] T 11111111111111111111111111111111 P bb3c5ad8b3754fa683d2c5eba78653c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "bb3c5ad8b3754fa683d2c5eba78653c2" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 39781 } }
I20260808 13:48:38.172063 21638 raft_consensus.cc:385] T 11111111111111111111111111111111 P bb3c5ad8b3754fa683d2c5eba78653c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:48:38.172327 21638 raft_consensus.cc:740] T 11111111111111111111111111111111 P bb3c5ad8b3754fa683d2c5eba78653c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb3c5ad8b3754fa683d2c5eba78653c2, State: Initialized, Role: FOLLOWER
I20260808 13:48:38.172947 21638 consensus_queue.cc:260] T 11111111111111111111111111111111 P bb3c5ad8b3754fa683d2c5eba78653c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "bb3c5ad8b3754fa683d2c5eba78653c2" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 39781 } }
I20260808 13:48:38.173542 21638 raft_consensus.cc:399] T 11111111111111111111111111111111 P bb3c5ad8b3754fa683d2c5eba78653c2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 13:48:38.173828 21638 raft_consensus.cc:493] T 11111111111111111111111111111111 P bb3c5ad8b3754fa683d2c5eba78653c2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 13:48:38.174160 21638 raft_consensus.cc:3060] T 11111111111111111111111111111111 P bb3c5ad8b3754fa683d2c5eba78653c2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:48:38.181116 21638 raft_consensus.cc:515] T 11111111111111111111111111111111 P bb3c5ad8b3754fa683d2c5eba78653c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "bb3c5ad8b3754fa683d2c5eba78653c2" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 39781 } }
I20260808 13:48:38.181846 21638 leader_election.cc:304] T 11111111111111111111111111111111 P bb3c5ad8b3754fa683d2c5eba78653c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bb3c5ad8b3754fa683d2c5eba78653c2; no voters:
I20260808 13:48:38.183230 21638 leader_election.cc:290] T 11111111111111111111111111111111 P bb3c5ad8b3754fa683d2c5eba78653c2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 13:48:38.183588 21640 raft_consensus.cc:2804] T 11111111111111111111111111111111 P bb3c5ad8b3754fa683d2c5eba78653c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 13:48:38.185385 21628 heartbeater.cc:499] Master 127.16.219.254:39721 was elected leader, sending a full tablet report...
I20260808 13:48:38.185629 21638 ts_tablet_manager.cc:1434] T 11111111111111111111111111111111 P bb3c5ad8b3754fa683d2c5eba78653c2: Time spent starting tablet: real 0.016s user 0.013s sys 0.005s
I20260808 13:48:38.186844 21640 raft_consensus.cc:697] T 11111111111111111111111111111111 P bb3c5ad8b3754fa683d2c5eba78653c2 [term 1 LEADER]: Becoming Leader. State: Replica: bb3c5ad8b3754fa683d2c5eba78653c2, State: Running, Role: LEADER
I20260808 13:48:38.187577 21640 consensus_queue.cc:237] T 11111111111111111111111111111111 P bb3c5ad8b3754fa683d2c5eba78653c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "bb3c5ad8b3754fa683d2c5eba78653c2" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 39781 } }
I20260808 13:48:38.191084 21641 tablet_replica.cc:442] T 11111111111111111111111111111111 P bb3c5ad8b3754fa683d2c5eba78653c2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bb3c5ad8b3754fa683d2c5eba78653c2" committed_config { opid_index: -1 peers { permanent_uuid: "bb3c5ad8b3754fa683d2c5eba78653c2" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 39781 } } }
I20260808 13:48:38.191713 21641 tablet_replica.cc:445] T 11111111111111111111111111111111 P bb3c5ad8b3754fa683d2c5eba78653c2: This TxnStatusTablet replica's current role is: LEADER
W20260808 13:48:38.193236 21481 catalog_manager.cc:5530] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260808 13:48:38.195950 21642 tablet_replica.cc:442] T 11111111111111111111111111111111 P bb3c5ad8b3754fa683d2c5eba78653c2: TxnStatusTablet state changed. Reason: New leader bb3c5ad8b3754fa683d2c5eba78653c2. Latest consensus state: current_term: 1 leader_uuid: "bb3c5ad8b3754fa683d2c5eba78653c2" committed_config { opid_index: -1 peers { permanent_uuid: "bb3c5ad8b3754fa683d2c5eba78653c2" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 39781 } } }
I20260808 13:48:38.196494 21642 tablet_replica.cc:445] T 11111111111111111111111111111111 P bb3c5ad8b3754fa683d2c5eba78653c2: This TxnStatusTablet replica's current role is: LEADER
W20260808 13:48:38.198731 21481 catalog_manager.cc:5530] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260808 13:48:38.203017 21645 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260808 13:48:38.203473 21645 txn_status_manager.cc:930] Loading transaction status metadata into memory...
W20260808 13:48:38.257128 21576 meta_cache.cc:788] Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
I20260808 13:48:38.257655 21576 txn_status_manager.cc:244] Participant participant of txn 1 returned error for BEGIN_COMMIT op, aborting: Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
I20260808 13:48:38.258064 21576 txn_status_manager.cc:206] Scheduling write for ABORT_IN_PROGRESS for txn 1
I20260808 13:48:38.268249 21576 txn_status_manager.cc:337] Participant participant was not found for ABORT_TXN, proceeding as if op succeeded: Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
I20260808 13:48:38.309147 21576 txn_status_manager.cc:244] Participant participant of txn 2 returned error for BEGIN_COMMIT op, aborting: Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
I20260808 13:48:38.309542 21576 txn_status_manager.cc:206] Scheduling write for ABORT_IN_PROGRESS for txn 2
I20260808 13:48:38.317950 21576 txn_status_manager.cc:337] Participant participant was not found for ABORT_TXN, proceeding as if op succeeded: Not found: LookupRpcById { tablet: 'participant', attempt: 1 } failed
W20260808 13:48:38.328192 21588 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:56494
W20260808 13:48:38.330525 21588 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:56494
W20260808 13:48:38.332533 21588 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:56494
W20260808 13:48:38.334848 21588 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:56494
W20260808 13:48:38.337044 21588 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:56494
W20260808 13:48:38.339226 21588 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='hughie'} at 127.0.0.1:56494
W20260808 13:48:38.348310 21588 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:56506
W20260808 13:48:38.350394 21588 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:56506
W20260808 13:48:38.352339 21588 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:56506
W20260808 13:48:38.354163 21588 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:56506
W20260808 13:48:38.356549 21588 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:56506
W20260808 13:48:38.359479 21588 server_base.cc:1143] Unauthorized access attempt to method kudu.tserver.TabletServerAdminService.CoordinateTransaction from {username='butcher'} at 127.0.0.1:56506
I20260808 13:48:38.364414 17263 tablet_server.cc:179] TabletServer@127.16.219.193:0 shutting down...
I20260808 13:48:38.387749 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 13:48:38.388652 17263 tablet_replica.cc:333] T 11111111111111111111111111111111 P bb3c5ad8b3754fa683d2c5eba78653c2: stopping tablet replica
I20260808 13:48:38.389304 17263 raft_consensus.cc:2243] T 11111111111111111111111111111111 P bb3c5ad8b3754fa683d2c5eba78653c2 [term 1 LEADER]: Raft consensus shutting down.
I20260808 13:48:38.389765 17263 raft_consensus.cc:2272] T 11111111111111111111111111111111 P bb3c5ad8b3754fa683d2c5eba78653c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:38.402581 17263 tablet_server.cc:196] TabletServer@127.16.219.193:0 shutdown complete.
I20260808 13:48:38.415468 17263 master.cc:562] Master@127.16.219.254:39721 shutting down...
I20260808 13:48:38.433378 17263 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 54f718b0ea1342008b50deff57d717a5 [term 1 LEADER]: Raft consensus shutting down.
I20260808 13:48:38.433938 17263 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 54f718b0ea1342008b50deff57d717a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:38.434338 17263 tablet_replica.cc:333] T 00000000000000000000000000000000 P 54f718b0ea1342008b50deff57d717a5: stopping tablet replica
I20260808 13:48:38.452867 17263 master.cc:584] Master@127.16.219.254:39721 shutdown complete.
[ OK ] TxnStatusTabletManagementTest.TestTabletServerProxyCalls (856 ms)
[ RUN ] TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors
I20260808 13:48:38.480499 17263 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.219.254:41841
I20260808 13:48:38.481626 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:48:38.486914 21655 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:38.487821 21656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:38.489418 21659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:48:38.490005 17263 server_base.cc:1061] running on GCE node
I20260808 13:48:38.490921 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:48:38.491155 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:48:38.491349 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196918491331 us; error 0 us; skew 500 ppm
I20260808 13:48:38.491971 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:48:38.494661 17263 webserver.cc:533] Webserver started at http://127.16.219.254:40391/ using document root <none> and password file <none>
I20260808 13:48:38.495221 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:48:38.495467 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:48:38.495779 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:48:38.497004 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786196858807110-17263-0/minicluster-data/master-0-root/instance:
uuid: "611875fff8b84649a877ead778616201"
format_stamp: "Formatted at 2026-08-08 13:48:38 on dist-test-slave-mn4r"
I20260808 13:48:38.502372 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260808 13:48:38.506028 21664 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:38.507035 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.004s sys 0.000s
I20260808 13:48:38.507287 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786196858807110-17263-0/minicluster-data/master-0-root
uuid: "611875fff8b84649a877ead778616201"
format_stamp: "Formatted at 2026-08-08 13:48:38 on dist-test-slave-mn4r"
I20260808 13:48:38.507537 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786196858807110-17263-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786196858807110-17263-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786196858807110-17263-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:48:38.532162 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:48:38.533216 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:48:38.569664 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.254:41841
I20260808 13:48:38.569765 21720 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.254:41841 every 8 connection(s)
I20260808 13:48:38.573581 21721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:48:38.583978 21721 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 611875fff8b84649a877ead778616201: Bootstrap starting.
I20260808 13:48:38.589720 21721 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 611875fff8b84649a877ead778616201: Neither blocks nor log segments found. Creating new log.
I20260808 13:48:38.593605 21721 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 611875fff8b84649a877ead778616201: No bootstrap required, opened a new log
I20260808 13:48:38.595640 21721 raft_consensus.cc:359] T 00000000000000000000000000000000 P 611875fff8b84649a877ead778616201 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "611875fff8b84649a877ead778616201" member_type: VOTER }
I20260808 13:48:38.596007 21721 raft_consensus.cc:385] T 00000000000000000000000000000000 P 611875fff8b84649a877ead778616201 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:48:38.596201 21721 raft_consensus.cc:740] T 00000000000000000000000000000000 P 611875fff8b84649a877ead778616201 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 611875fff8b84649a877ead778616201, State: Initialized, Role: FOLLOWER
I20260808 13:48:38.596760 21721 consensus_queue.cc:260] T 00000000000000000000000000000000 P 611875fff8b84649a877ead778616201 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "611875fff8b84649a877ead778616201" member_type: VOTER }
I20260808 13:48:38.597215 21721 raft_consensus.cc:399] T 00000000000000000000000000000000 P 611875fff8b84649a877ead778616201 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 13:48:38.597404 21721 raft_consensus.cc:493] T 00000000000000000000000000000000 P 611875fff8b84649a877ead778616201 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 13:48:38.597612 21721 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 611875fff8b84649a877ead778616201 [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:48:38.601976 21721 raft_consensus.cc:515] T 00000000000000000000000000000000 P 611875fff8b84649a877ead778616201 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "611875fff8b84649a877ead778616201" member_type: VOTER }
I20260808 13:48:38.602517 21721 leader_election.cc:304] T 00000000000000000000000000000000 P 611875fff8b84649a877ead778616201 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 611875fff8b84649a877ead778616201; no voters:
I20260808 13:48:38.603593 21721 leader_election.cc:290] T 00000000000000000000000000000000 P 611875fff8b84649a877ead778616201 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 13:48:38.603936 21724 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 611875fff8b84649a877ead778616201 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 13:48:38.605242 21724 raft_consensus.cc:697] T 00000000000000000000000000000000 P 611875fff8b84649a877ead778616201 [term 1 LEADER]: Becoming Leader. State: Replica: 611875fff8b84649a877ead778616201, State: Running, Role: LEADER
I20260808 13:48:38.605931 21724 consensus_queue.cc:237] T 00000000000000000000000000000000 P 611875fff8b84649a877ead778616201 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "611875fff8b84649a877ead778616201" member_type: VOTER }
I20260808 13:48:38.606606 21721 sys_catalog.cc:565] T 00000000000000000000000000000000 P 611875fff8b84649a877ead778616201 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 13:48:38.608484 21725 sys_catalog.cc:455] T 00000000000000000000000000000000 P 611875fff8b84649a877ead778616201 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "611875fff8b84649a877ead778616201" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "611875fff8b84649a877ead778616201" member_type: VOTER } }
I20260808 13:48:38.609004 21725 sys_catalog.cc:458] T 00000000000000000000000000000000 P 611875fff8b84649a877ead778616201 [sys.catalog]: This master's current role is: LEADER
I20260808 13:48:38.609652 21726 sys_catalog.cc:455] T 00000000000000000000000000000000 P 611875fff8b84649a877ead778616201 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 611875fff8b84649a877ead778616201. Latest consensus state: current_term: 1 leader_uuid: "611875fff8b84649a877ead778616201" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "611875fff8b84649a877ead778616201" member_type: VOTER } }
I20260808 13:48:38.611115 21726 sys_catalog.cc:458] T 00000000000000000000000000000000 P 611875fff8b84649a877ead778616201 [sys.catalog]: This master's current role is: LEADER
I20260808 13:48:38.614595 21729 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 13:48:38.619973 21729 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 13:48:38.622999 17263 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260808 13:48:38.628854 21729 catalog_manager.cc:1383] Generated new cluster ID: 9c1154be9df743d2a40cb95c612164e7
I20260808 13:48:38.629122 21729 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 13:48:38.660985 21729 catalog_manager.cc:1406] Generated new certificate authority record
I20260808 13:48:38.662289 21729 catalog_manager.cc:1540] Loading token signing keys...
I20260808 13:48:38.678565 21729 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 611875fff8b84649a877ead778616201: Generated new TSK 0
I20260808 13:48:38.679139 21729 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 13:48:38.690016 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:48:38.696123 21742 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:38.697774 21743 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:38.700910 21746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:48:38.700991 17263 server_base.cc:1061] running on GCE node
I20260808 13:48:38.702005 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:48:38.702310 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:48:38.702503 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196918702482 us; error 0 us; skew 500 ppm
I20260808 13:48:38.703037 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:48:38.705240 17263 webserver.cc:533] Webserver started at http://127.16.219.193:34367/ using document root <none> and password file <none>
I20260808 13:48:38.705746 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:48:38.705973 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:48:38.706277 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:48:38.707367 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786196858807110-17263-0/minicluster-data/ts-0-root/instance:
uuid: "0ba83af0fa49486bbe84433613d0e8d9"
format_stamp: "Formatted at 2026-08-08 13:48:38 on dist-test-slave-mn4r"
I20260808 13:48:38.712457 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 13:48:38.715762 21751 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:38.716663 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 13:48:38.716908 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786196858807110-17263-0/minicluster-data/ts-0-root
uuid: "0ba83af0fa49486bbe84433613d0e8d9"
format_stamp: "Formatted at 2026-08-08 13:48:38 on dist-test-slave-mn4r"
I20260808 13:48:38.717152 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786196858807110-17263-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786196858807110-17263-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors.1786196858807110-17263-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:48:38.742204 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:48:38.743249 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:48:38.748602 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 13:48:38.748989 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:38.749441 17263 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 13:48:38.749794 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:38.802790 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.193:33825
I20260808 13:48:38.802891 21830 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.193:33825 every 8 connection(s)
I20260808 13:48:38.807639 21831 heartbeater.cc:344] Connected to a master server at 127.16.219.254:41841
I20260808 13:48:38.807986 21831 heartbeater.cc:461] Registering TS with master...
I20260808 13:48:38.808736 21831 heartbeater.cc:507] Master 127.16.219.254:41841 requested a full tablet report, sending...
I20260808 13:48:38.810772 21682 ts_manager.cc:194] Registered new tserver with Master: 0ba83af0fa49486bbe84433613d0e8d9 (127.16.219.193:33825)
I20260808 13:48:38.811122 17263 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.004997972s
I20260808 13:48:38.812534 21682 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53072
I20260808 13:48:38.841004 21794 tablet_service.cc:1511] Processing CreateTablet for tablet 11111111111111111111111111111111 (TXN_STATUS_TABLE table=11111111111111111111111111111111_table_name [id=11111111111111111111111111111111_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20260808 13:48:38.842262 21794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11111111111111111111111111111111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:48:38.853296 21842 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 0ba83af0fa49486bbe84433613d0e8d9: Bootstrap starting.
I20260808 13:48:38.857810 21842 tablet_bootstrap.cc:654] T 11111111111111111111111111111111 P 0ba83af0fa49486bbe84433613d0e8d9: Neither blocks nor log segments found. Creating new log.
I20260808 13:48:38.861768 21842 tablet_bootstrap.cc:492] T 11111111111111111111111111111111 P 0ba83af0fa49486bbe84433613d0e8d9: No bootstrap required, opened a new log
I20260808 13:48:38.862233 21842 ts_tablet_manager.cc:1403] T 11111111111111111111111111111111 P 0ba83af0fa49486bbe84433613d0e8d9: Time spent bootstrapping tablet: real 0.009s user 0.009s sys 0.000s
I20260808 13:48:38.864217 21842 raft_consensus.cc:359] T 11111111111111111111111111111111 P 0ba83af0fa49486bbe84433613d0e8d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "0ba83af0fa49486bbe84433613d0e8d9" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 33825 } }
I20260808 13:48:38.864593 21842 raft_consensus.cc:385] T 11111111111111111111111111111111 P 0ba83af0fa49486bbe84433613d0e8d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:48:38.864771 21842 raft_consensus.cc:740] T 11111111111111111111111111111111 P 0ba83af0fa49486bbe84433613d0e8d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ba83af0fa49486bbe84433613d0e8d9, State: Initialized, Role: FOLLOWER
I20260808 13:48:38.865334 21842 consensus_queue.cc:260] T 11111111111111111111111111111111 P 0ba83af0fa49486bbe84433613d0e8d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "0ba83af0fa49486bbe84433613d0e8d9" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 33825 } }
I20260808 13:48:38.865754 21842 raft_consensus.cc:399] T 11111111111111111111111111111111 P 0ba83af0fa49486bbe84433613d0e8d9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 13:48:38.865944 21842 raft_consensus.cc:493] T 11111111111111111111111111111111 P 0ba83af0fa49486bbe84433613d0e8d9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 13:48:38.866230 21842 raft_consensus.cc:3060] T 11111111111111111111111111111111 P 0ba83af0fa49486bbe84433613d0e8d9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:48:38.870743 21842 raft_consensus.cc:515] T 11111111111111111111111111111111 P 0ba83af0fa49486bbe84433613d0e8d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "0ba83af0fa49486bbe84433613d0e8d9" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 33825 } }
I20260808 13:48:38.871215 21842 leader_election.cc:304] T 11111111111111111111111111111111 P 0ba83af0fa49486bbe84433613d0e8d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ba83af0fa49486bbe84433613d0e8d9; no voters:
I20260808 13:48:38.872447 21842 leader_election.cc:290] T 11111111111111111111111111111111 P 0ba83af0fa49486bbe84433613d0e8d9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 13:48:38.872889 21845 raft_consensus.cc:2804] T 11111111111111111111111111111111 P 0ba83af0fa49486bbe84433613d0e8d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 13:48:38.874469 21831 heartbeater.cc:499] Master 127.16.219.254:41841 was elected leader, sending a full tablet report...
I20260808 13:48:38.874696 21842 ts_tablet_manager.cc:1434] T 11111111111111111111111111111111 P 0ba83af0fa49486bbe84433613d0e8d9: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
I20260808 13:48:38.875165 21845 raft_consensus.cc:697] T 11111111111111111111111111111111 P 0ba83af0fa49486bbe84433613d0e8d9 [term 1 LEADER]: Becoming Leader. State: Replica: 0ba83af0fa49486bbe84433613d0e8d9, State: Running, Role: LEADER
I20260808 13:48:38.875906 21845 consensus_queue.cc:237] T 11111111111111111111111111111111 P 0ba83af0fa49486bbe84433613d0e8d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "0ba83af0fa49486bbe84433613d0e8d9" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 33825 } }
I20260808 13:48:38.880788 21847 tablet_replica.cc:442] T 11111111111111111111111111111111 P 0ba83af0fa49486bbe84433613d0e8d9: TxnStatusTablet state changed. Reason: New leader 0ba83af0fa49486bbe84433613d0e8d9. Latest consensus state: current_term: 1 leader_uuid: "0ba83af0fa49486bbe84433613d0e8d9" committed_config { opid_index: -1 peers { permanent_uuid: "0ba83af0fa49486bbe84433613d0e8d9" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 33825 } } }
I20260808 13:48:38.881402 21847 tablet_replica.cc:445] T 11111111111111111111111111111111 P 0ba83af0fa49486bbe84433613d0e8d9: This TxnStatusTablet replica's current role is: LEADER
I20260808 13:48:38.881211 21846 tablet_replica.cc:442] T 11111111111111111111111111111111 P 0ba83af0fa49486bbe84433613d0e8d9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0ba83af0fa49486bbe84433613d0e8d9" committed_config { opid_index: -1 peers { permanent_uuid: "0ba83af0fa49486bbe84433613d0e8d9" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 33825 } } }
I20260808 13:48:38.882069 21846 tablet_replica.cc:445] T 11111111111111111111111111111111 P 0ba83af0fa49486bbe84433613d0e8d9: This TxnStatusTablet replica's current role is: LEADER
W20260808 13:48:38.882833 21682 catalog_manager.cc:5530] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260808 13:48:38.885012 21850 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260808 13:48:38.885465 21850 txn_status_manager.cc:930] Loading transaction status metadata into memory...
W20260808 13:48:38.887193 21682 catalog_manager.cc:5530] Ignoring report from unknown tablet 11111111111111111111111111111111
I20260808 13:48:38.912177 21794 tablet_service.cc:1511] Processing CreateTablet for tablet 22222222222222222222222222222222 (table=22222222222222222222222222222222_table_name [id=22222222222222222222222222222222_table_id]), partition=RANGE (txn_id, entry_type, identifier) PARTITION (0, -128, "") <= VALUES < (100, -128, "")
I20260808 13:48:38.913295 21794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22222222222222222222222222222222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:48:38.924167 21842 tablet_bootstrap.cc:492] T 22222222222222222222222222222222 P 0ba83af0fa49486bbe84433613d0e8d9: Bootstrap starting.
I20260808 13:48:38.928814 21842 tablet_bootstrap.cc:654] T 22222222222222222222222222222222 P 0ba83af0fa49486bbe84433613d0e8d9: Neither blocks nor log segments found. Creating new log.
I20260808 13:48:38.932897 21842 tablet_bootstrap.cc:492] T 22222222222222222222222222222222 P 0ba83af0fa49486bbe84433613d0e8d9: No bootstrap required, opened a new log
I20260808 13:48:38.933328 21842 ts_tablet_manager.cc:1403] T 22222222222222222222222222222222 P 0ba83af0fa49486bbe84433613d0e8d9: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260808 13:48:38.935348 21842 raft_consensus.cc:359] T 22222222222222222222222222222222 P 0ba83af0fa49486bbe84433613d0e8d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 peers { permanent_uuid: "0ba83af0fa49486bbe84433613d0e8d9" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 33825 } }
I20260808 13:48:38.935779 21842 raft_consensus.cc:385] T 22222222222222222222222222222222 P 0ba83af0fa49486bbe84433613d0e8d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:48:38.936012 21842 raft_consensus.cc:740] T 22222222222222222222222222222222 P 0ba83af0fa49486bbe84433613d0e8d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ba83af0fa49486bbe84433613d0e8d9, State: Initialized, Role: FOLLOWER
I20260808 13:48:38.936748 21842 consensus_queue.cc:260] T 22222222222222222222222222222222 P 0ba83af0fa49486bbe84433613d0e8d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "0ba83af0fa49486bbe84433613d0e8d9" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 33825 } }
I20260808 13:48:38.937252 21842 raft_consensus.cc:399] T 22222222222222222222222222222222 P 0ba83af0fa49486bbe84433613d0e8d9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 13:48:38.937502 21842 raft_consensus.cc:493] T 22222222222222222222222222222222 P 0ba83af0fa49486bbe84433613d0e8d9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 13:48:38.937783 21842 raft_consensus.cc:3060] T 22222222222222222222222222222222 P 0ba83af0fa49486bbe84433613d0e8d9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:48:38.942638 21842 raft_consensus.cc:515] T 22222222222222222222222222222222 P 0ba83af0fa49486bbe84433613d0e8d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 peers { permanent_uuid: "0ba83af0fa49486bbe84433613d0e8d9" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 33825 } }
I20260808 13:48:38.943204 21842 leader_election.cc:304] T 22222222222222222222222222222222 P 0ba83af0fa49486bbe84433613d0e8d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ba83af0fa49486bbe84433613d0e8d9; no voters:
I20260808 13:48:38.943693 21842 leader_election.cc:290] T 22222222222222222222222222222222 P 0ba83af0fa49486bbe84433613d0e8d9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 13:48:38.943894 21847 raft_consensus.cc:2804] T 22222222222222222222222222222222 P 0ba83af0fa49486bbe84433613d0e8d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 13:48:38.944408 21847 raft_consensus.cc:697] T 22222222222222222222222222222222 P 0ba83af0fa49486bbe84433613d0e8d9 [term 1 LEADER]: Becoming Leader. State: Replica: 0ba83af0fa49486bbe84433613d0e8d9, State: Running, Role: LEADER
I20260808 13:48:38.945204 21842 ts_tablet_manager.cc:1434] T 22222222222222222222222222222222 P 0ba83af0fa49486bbe84433613d0e8d9: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20260808 13:48:38.945097 21847 consensus_queue.cc:237] T 22222222222222222222222222222222 P 0ba83af0fa49486bbe84433613d0e8d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 peers { permanent_uuid: "0ba83af0fa49486bbe84433613d0e8d9" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 33825 } }
W20260808 13:48:38.950188 21682 catalog_manager.cc:5530] Ignoring report from unknown tablet 22222222222222222222222222222222
W20260808 13:48:38.954198 21682 catalog_manager.cc:5530] Ignoring report from unknown tablet 22222222222222222222222222222222
I20260808 13:48:38.973919 17263 tablet_server.cc:179] TabletServer@127.16.219.193:0 shutting down...
I20260808 13:48:38.995270 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 13:48:38.996212 17263 tablet_replica.cc:333] T 22222222222222222222222222222222 P 0ba83af0fa49486bbe84433613d0e8d9: stopping tablet replica
I20260808 13:48:38.996857 17263 raft_consensus.cc:2243] T 22222222222222222222222222222222 P 0ba83af0fa49486bbe84433613d0e8d9 [term 1 LEADER]: Raft consensus shutting down.
I20260808 13:48:38.997351 17263 raft_consensus.cc:2272] T 22222222222222222222222222222222 P 0ba83af0fa49486bbe84433613d0e8d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:39.000118 17263 tablet_replica.cc:333] T 11111111111111111111111111111111 P 0ba83af0fa49486bbe84433613d0e8d9: stopping tablet replica
I20260808 13:48:39.000614 17263 raft_consensus.cc:2243] T 11111111111111111111111111111111 P 0ba83af0fa49486bbe84433613d0e8d9 [term 1 LEADER]: Raft consensus shutting down.
I20260808 13:48:39.001093 17263 raft_consensus.cc:2272] T 11111111111111111111111111111111 P 0ba83af0fa49486bbe84433613d0e8d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:39.023458 17263 tablet_server.cc:196] TabletServer@127.16.219.193:0 shutdown complete.
I20260808 13:48:39.035696 17263 master.cc:562] Master@127.16.219.254:41841 shutting down...
I20260808 13:48:39.052886 17263 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 611875fff8b84649a877ead778616201 [term 1 LEADER]: Raft consensus shutting down.
I20260808 13:48:39.053453 17263 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 611875fff8b84649a877ead778616201 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:39.053938 17263 tablet_replica.cc:333] T 00000000000000000000000000000000 P 611875fff8b84649a877ead778616201: stopping tablet replica
I20260808 13:48:39.072932 17263 master.cc:584] Master@127.16.219.254:41841 shutdown complete.
[ OK ] TxnStatusTabletManagementTest.TestTabletServerProxyCallErrors (617 ms)
[----------] 4 tests from TxnStatusTabletManagementTest (3604 ms total)
[----------] 2 tests from FailedTabletsAreReplacedITest
[ RUN ] FailedTabletsAreReplacedITest.OneReplica/0
I20260808 13:48:39.098169 17263 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.219.254:43775
I20260808 13:48:39.099275 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:48:39.104059 21859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:39.105402 21861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:39.106961 21863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:48:39.107357 17263 server_base.cc:1061] running on GCE node
I20260808 13:48:39.108160 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:48:39.108369 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:48:39.108573 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196919108555 us; error 0 us; skew 500 ppm
I20260808 13:48:39.109143 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:48:39.111483 17263 webserver.cc:533] Webserver started at http://127.16.219.254:42323/ using document root <none> and password file <none>
I20260808 13:48:39.111991 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:48:39.112207 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:48:39.112567 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:48:39.113683 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786196858807110-17263-0/minicluster-data/master-0-root/instance:
uuid: "c18223fc7b964846abd82f3b76b0fe9a"
format_stamp: "Formatted at 2026-08-08 13:48:39 on dist-test-slave-mn4r"
I20260808 13:48:39.118474 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20260808 13:48:39.121714 21869 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:39.122556 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 13:48:39.122845 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786196858807110-17263-0/minicluster-data/master-0-root
uuid: "c18223fc7b964846abd82f3b76b0fe9a"
format_stamp: "Formatted at 2026-08-08 13:48:39 on dist-test-slave-mn4r"
I20260808 13:48:39.123139 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786196858807110-17263-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786196858807110-17263-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786196858807110-17263-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:48:39.133011 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:48:39.134011 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:48:39.169889 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.254:43775
I20260808 13:48:39.169996 21923 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.254:43775 every 8 connection(s)
I20260808 13:48:39.173695 21924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:48:39.183790 21924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c18223fc7b964846abd82f3b76b0fe9a: Bootstrap starting.
I20260808 13:48:39.188442 21924 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c18223fc7b964846abd82f3b76b0fe9a: Neither blocks nor log segments found. Creating new log.
I20260808 13:48:39.192317 21924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c18223fc7b964846abd82f3b76b0fe9a: No bootstrap required, opened a new log
I20260808 13:48:39.194394 21924 raft_consensus.cc:359] T 00000000000000000000000000000000 P c18223fc7b964846abd82f3b76b0fe9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c18223fc7b964846abd82f3b76b0fe9a" member_type: VOTER }
I20260808 13:48:39.194787 21924 raft_consensus.cc:385] T 00000000000000000000000000000000 P c18223fc7b964846abd82f3b76b0fe9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:48:39.195065 21924 raft_consensus.cc:740] T 00000000000000000000000000000000 P c18223fc7b964846abd82f3b76b0fe9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18223fc7b964846abd82f3b76b0fe9a, State: Initialized, Role: FOLLOWER
I20260808 13:48:39.195737 21924 consensus_queue.cc:260] T 00000000000000000000000000000000 P c18223fc7b964846abd82f3b76b0fe9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c18223fc7b964846abd82f3b76b0fe9a" member_type: VOTER }
I20260808 13:48:39.196233 21924 raft_consensus.cc:399] T 00000000000000000000000000000000 P c18223fc7b964846abd82f3b76b0fe9a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 13:48:39.196491 21924 raft_consensus.cc:493] T 00000000000000000000000000000000 P c18223fc7b964846abd82f3b76b0fe9a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 13:48:39.196766 21924 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c18223fc7b964846abd82f3b76b0fe9a [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:48:39.201462 21924 raft_consensus.cc:515] T 00000000000000000000000000000000 P c18223fc7b964846abd82f3b76b0fe9a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c18223fc7b964846abd82f3b76b0fe9a" member_type: VOTER }
I20260808 13:48:39.202023 21924 leader_election.cc:304] T 00000000000000000000000000000000 P c18223fc7b964846abd82f3b76b0fe9a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c18223fc7b964846abd82f3b76b0fe9a; no voters:
I20260808 13:48:39.203212 21924 leader_election.cc:290] T 00000000000000000000000000000000 P c18223fc7b964846abd82f3b76b0fe9a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 13:48:39.203541 21927 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c18223fc7b964846abd82f3b76b0fe9a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 13:48:39.204947 21927 raft_consensus.cc:697] T 00000000000000000000000000000000 P c18223fc7b964846abd82f3b76b0fe9a [term 1 LEADER]: Becoming Leader. State: Replica: c18223fc7b964846abd82f3b76b0fe9a, State: Running, Role: LEADER
I20260808 13:48:39.205608 21927 consensus_queue.cc:237] T 00000000000000000000000000000000 P c18223fc7b964846abd82f3b76b0fe9a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c18223fc7b964846abd82f3b76b0fe9a" member_type: VOTER }
I20260808 13:48:39.206269 21924 sys_catalog.cc:565] T 00000000000000000000000000000000 P c18223fc7b964846abd82f3b76b0fe9a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 13:48:39.208381 21928 sys_catalog.cc:455] T 00000000000000000000000000000000 P c18223fc7b964846abd82f3b76b0fe9a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c18223fc7b964846abd82f3b76b0fe9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c18223fc7b964846abd82f3b76b0fe9a" member_type: VOTER } }
I20260808 13:48:39.208956 21928 sys_catalog.cc:458] T 00000000000000000000000000000000 P c18223fc7b964846abd82f3b76b0fe9a [sys.catalog]: This master's current role is: LEADER
I20260808 13:48:39.209414 21929 sys_catalog.cc:455] T 00000000000000000000000000000000 P c18223fc7b964846abd82f3b76b0fe9a [sys.catalog]: SysCatalogTable state changed. Reason: New leader c18223fc7b964846abd82f3b76b0fe9a. Latest consensus state: current_term: 1 leader_uuid: "c18223fc7b964846abd82f3b76b0fe9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c18223fc7b964846abd82f3b76b0fe9a" member_type: VOTER } }
I20260808 13:48:39.209918 21929 sys_catalog.cc:458] T 00000000000000000000000000000000 P c18223fc7b964846abd82f3b76b0fe9a [sys.catalog]: This master's current role is: LEADER
I20260808 13:48:39.212204 21932 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 13:48:39.216794 21932 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 13:48:39.222883 17263 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260808 13:48:39.225839 21932 catalog_manager.cc:1383] Generated new cluster ID: bfbb5c1c4684415285339b3990eefa00
I20260808 13:48:39.226040 21932 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 13:48:39.250054 21932 catalog_manager.cc:1406] Generated new certificate authority record
I20260808 13:48:39.251319 21932 catalog_manager.cc:1540] Loading token signing keys...
I20260808 13:48:39.280040 21932 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c18223fc7b964846abd82f3b76b0fe9a: Generated new TSK 0
I20260808 13:48:39.280690 21932 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 13:48:39.291685 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:48:39.297688 21947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:39.298974 21948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:39.300536 21950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:48:39.300838 17263 server_base.cc:1061] running on GCE node
I20260808 13:48:39.301712 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:48:39.301939 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:48:39.302184 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196919302165 us; error 0 us; skew 500 ppm
I20260808 13:48:39.302727 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:48:39.309777 17263 webserver.cc:533] Webserver started at http://127.16.219.193:42019/ using document root <none> and password file <none>
I20260808 13:48:39.310362 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:48:39.310563 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:48:39.310838 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:48:39.312059 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786196858807110-17263-0/minicluster-data/ts-0-root/instance:
uuid: "d795958abdd74e9aaa4aca0ba4eaef96"
format_stamp: "Formatted at 2026-08-08 13:48:39 on dist-test-slave-mn4r"
I20260808 13:48:39.317207 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260808 13:48:39.320662 21955 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:39.321389 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 13:48:39.321692 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786196858807110-17263-0/minicluster-data/ts-0-root
uuid: "d795958abdd74e9aaa4aca0ba4eaef96"
format_stamp: "Formatted at 2026-08-08 13:48:39 on dist-test-slave-mn4r"
I20260808 13:48:39.322000 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786196858807110-17263-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786196858807110-17263-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786196858807110-17263-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:48:39.363582 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:48:39.365012 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:48:39.366711 17263 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 13:48:39.369524 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 13:48:39.369752 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:39.370059 17263 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 13:48:39.370329 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260808 13:48:39.417510 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.193:40131
I20260808 13:48:39.417722 22025 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.193:40131 every 8 connection(s)
I20260808 13:48:39.424763 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:48:39.435668 22030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:39.438732 22031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:39.440750 22033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:48:39.443975 17263 server_base.cc:1061] running on GCE node
I20260808 13:48:39.445163 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:48:39.445411 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:48:39.445624 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196919445605 us; error 0 us; skew 500 ppm
I20260808 13:48:39.446283 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:48:39.448853 17263 webserver.cc:533] Webserver started at http://127.16.219.194:41315/ using document root <none> and password file <none>
I20260808 13:48:39.449436 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:48:39.449661 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:48:39.450040 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:48:39.452273 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786196858807110-17263-0/minicluster-data/ts-1-root/instance:
uuid: "046f7c3632f446758ef8723338d9ecb2"
format_stamp: "Formatted at 2026-08-08 13:48:39 on dist-test-slave-mn4r"
I20260808 13:48:39.453672 22026 heartbeater.cc:344] Connected to a master server at 127.16.219.254:43775
I20260808 13:48:39.454066 22026 heartbeater.cc:461] Registering TS with master...
I20260808 13:48:39.454914 22026 heartbeater.cc:507] Master 127.16.219.254:43775 requested a full tablet report, sending...
I20260808 13:48:39.457396 21888 ts_manager.cc:194] Registered new tserver with Master: d795958abdd74e9aaa4aca0ba4eaef96 (127.16.219.193:40131)
I20260808 13:48:39.458937 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260808 13:48:39.459882 21888 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39134
I20260808 13:48:39.463466 22040 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:39.464272 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.002s
I20260808 13:48:39.464596 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786196858807110-17263-0/minicluster-data/ts-1-root
uuid: "046f7c3632f446758ef8723338d9ecb2"
format_stamp: "Formatted at 2026-08-08 13:48:39 on dist-test-slave-mn4r"
I20260808 13:48:39.464866 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786196858807110-17263-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786196858807110-17263-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786196858807110-17263-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:48:39.520924 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:48:39.522372 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:48:39.523989 17263 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 13:48:39.526466 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 13:48:39.526700 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:39.526947 17263 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 13:48:39.527117 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:39.569934 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.194:41369
I20260808 13:48:39.570055 22111 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.194:41369 every 8 connection(s)
I20260808 13:48:39.575249 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:48:39.584048 22115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:39.584167 22116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:48:39.588780 22112 heartbeater.cc:344] Connected to a master server at 127.16.219.254:43775
I20260808 13:48:39.589210 22112 heartbeater.cc:461] Registering TS with master...
I20260808 13:48:39.590157 22112 heartbeater.cc:507] Master 127.16.219.254:43775 requested a full tablet report, sending...
I20260808 13:48:39.593163 21888 ts_manager.cc:194] Registered new tserver with Master: 046f7c3632f446758ef8723338d9ecb2 (127.16.219.194:41369)
I20260808 13:48:39.594390 17263 server_base.cc:1061] running on GCE node
W20260808 13:48:39.594901 22119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:48:39.595681 21888 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39138
I20260808 13:48:39.596061 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:48:39.596311 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:48:39.596500 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196919596483 us; error 0 us; skew 500 ppm
I20260808 13:48:39.597132 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:48:39.599695 17263 webserver.cc:533] Webserver started at http://127.16.219.195:39817/ using document root <none> and password file <none>
I20260808 13:48:39.600198 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:48:39.600412 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:48:39.600692 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:48:39.602005 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786196858807110-17263-0/minicluster-data/ts-2-root/instance:
uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294"
format_stamp: "Formatted at 2026-08-08 13:48:39 on dist-test-slave-mn4r"
I20260808 13:48:39.606796 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 13:48:39.610270 22124 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:39.611084 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 13:48:39.611380 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786196858807110-17263-0/minicluster-data/ts-2-root
uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294"
format_stamp: "Formatted at 2026-08-08 13:48:39 on dist-test-slave-mn4r"
I20260808 13:48:39.611682 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786196858807110-17263-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786196858807110-17263-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786196858807110-17263-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:48:39.632030 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:48:39.633543 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:48:39.635038 17263 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 13:48:39.637596 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 13:48:39.637938 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:39.638247 17263 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 13:48:39.638453 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:39.684630 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.195:44219
I20260808 13:48:39.684726 22191 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.195:44219 every 8 connection(s)
I20260808 13:48:39.700322 22192 heartbeater.cc:344] Connected to a master server at 127.16.219.254:43775
I20260808 13:48:39.700712 22192 heartbeater.cc:461] Registering TS with master...
I20260808 13:48:39.701454 22192 heartbeater.cc:507] Master 127.16.219.254:43775 requested a full tablet report, sending...
I20260808 13:48:39.703517 21888 ts_manager.cc:194] Registered new tserver with Master: bf06bf0eaa8b48daaeda6cff3ec6c294 (127.16.219.195:44219)
I20260808 13:48:39.704275 17263 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016161812s
I20260808 13:48:39.705411 21888 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39146
I20260808 13:48:39.749332 21888 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39164:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 13:48:39.803920 22070 tablet_service.cc:1511] Processing CreateTablet for tablet afcd631b2887406584ce098a503f17d9 (DEFAULT_TABLE table=test-workload [id=e6a96488d5fa46a597f3fad3e86c919e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 13:48:39.803920 21986 tablet_service.cc:1511] Processing CreateTablet for tablet afcd631b2887406584ce098a503f17d9 (DEFAULT_TABLE table=test-workload [id=e6a96488d5fa46a597f3fad3e86c919e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 13:48:39.805718 22070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afcd631b2887406584ce098a503f17d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:48:39.805751 21986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afcd631b2887406584ce098a503f17d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:48:39.811265 22154 tablet_service.cc:1511] Processing CreateTablet for tablet afcd631b2887406584ce098a503f17d9 (DEFAULT_TABLE table=test-workload [id=e6a96488d5fa46a597f3fad3e86c919e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 13:48:39.812297 22154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afcd631b2887406584ce098a503f17d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:48:39.825223 22215 tablet_bootstrap.cc:492] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2: Bootstrap starting.
I20260808 13:48:39.827462 22216 tablet_bootstrap.cc:492] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96: Bootstrap starting.
I20260808 13:48:39.830539 22217 tablet_bootstrap.cc:492] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294: Bootstrap starting.
I20260808 13:48:39.833848 22215 tablet_bootstrap.cc:654] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2: Neither blocks nor log segments found. Creating new log.
I20260808 13:48:39.835462 22216 tablet_bootstrap.cc:654] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96: Neither blocks nor log segments found. Creating new log.
I20260808 13:48:39.839062 22217 tablet_bootstrap.cc:654] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294: Neither blocks nor log segments found. Creating new log.
I20260808 13:48:39.840678 22215 tablet_bootstrap.cc:492] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2: No bootstrap required, opened a new log
I20260808 13:48:39.841230 22215 ts_tablet_manager.cc:1403] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2: Time spent bootstrapping tablet: real 0.016s user 0.012s sys 0.000s
I20260808 13:48:39.842371 22216 tablet_bootstrap.cc:492] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96: No bootstrap required, opened a new log
I20260808 13:48:39.843029 22216 ts_tablet_manager.cc:1403] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96: Time spent bootstrapping tablet: real 0.016s user 0.015s sys 0.000s
I20260808 13:48:39.844849 22217 tablet_bootstrap.cc:492] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294: No bootstrap required, opened a new log
I20260808 13:48:39.844632 22215 raft_consensus.cc:359] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 } } peers { permanent_uuid: "d795958abdd74e9aaa4aca0ba4eaef96" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40131 } } peers { permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 } }
I20260808 13:48:39.845403 22217 ts_tablet_manager.cc:1403] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.004s
I20260808 13:48:39.845721 22215 raft_consensus.cc:385] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:48:39.845444 22216 raft_consensus.cc:359] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 } } peers { permanent_uuid: "d795958abdd74e9aaa4aca0ba4eaef96" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40131 } } peers { permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 } }
I20260808 13:48:39.846199 22215 raft_consensus.cc:740] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 046f7c3632f446758ef8723338d9ecb2, State: Initialized, Role: FOLLOWER
I20260808 13:48:39.846381 22216 raft_consensus.cc:385] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:48:39.846812 22216 raft_consensus.cc:740] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d795958abdd74e9aaa4aca0ba4eaef96, State: Initialized, Role: FOLLOWER
I20260808 13:48:39.847178 22215 consensus_queue.cc:260] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 } } peers { permanent_uuid: "d795958abdd74e9aaa4aca0ba4eaef96" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40131 } } peers { permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 } }
I20260808 13:48:39.847621 22216 consensus_queue.cc:260] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 } } peers { permanent_uuid: "d795958abdd74e9aaa4aca0ba4eaef96" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40131 } } peers { permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 } }
I20260808 13:48:39.848863 22217 raft_consensus.cc:359] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 } } peers { permanent_uuid: "d795958abdd74e9aaa4aca0ba4eaef96" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40131 } } peers { permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 } }
I20260808 13:48:39.849812 22217 raft_consensus.cc:385] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:48:39.850201 22217 raft_consensus.cc:740] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf06bf0eaa8b48daaeda6cff3ec6c294, State: Initialized, Role: FOLLOWER
I20260808 13:48:39.851295 22217 consensus_queue.cc:260] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 } } peers { permanent_uuid: "d795958abdd74e9aaa4aca0ba4eaef96" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40131 } } peers { permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 } }
I20260808 13:48:39.854394 22216 ts_tablet_manager.cc:1434] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96: Time spent starting tablet: real 0.011s user 0.006s sys 0.004s
I20260808 13:48:39.859812 22026 heartbeater.cc:499] Master 127.16.219.254:43775 was elected leader, sending a full tablet report...
I20260808 13:48:39.860106 22215 ts_tablet_manager.cc:1434] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2: Time spent starting tablet: real 0.019s user 0.012s sys 0.007s
I20260808 13:48:39.860175 22112 heartbeater.cc:499] Master 127.16.219.254:43775 was elected leader, sending a full tablet report...
I20260808 13:48:39.861712 22225 raft_consensus.cc:493] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 13:48:39.862345 22225 raft_consensus.cc:515] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 } } peers { permanent_uuid: "d795958abdd74e9aaa4aca0ba4eaef96" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40131 } } peers { permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 } }
I20260808 13:48:39.865257 22225 leader_election.cc:290] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 046f7c3632f446758ef8723338d9ecb2 (127.16.219.194:41369), bf06bf0eaa8b48daaeda6cff3ec6c294 (127.16.219.195:44219)
I20260808 13:48:39.887398 22080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcd631b2887406584ce098a503f17d9" candidate_uuid: "d795958abdd74e9aaa4aca0ba4eaef96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "046f7c3632f446758ef8723338d9ecb2" is_pre_election: true
I20260808 13:48:39.888597 22080 raft_consensus.cc:2468] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d795958abdd74e9aaa4aca0ba4eaef96 in term 0.
I20260808 13:48:39.890313 21958 leader_election.cc:304] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 046f7c3632f446758ef8723338d9ecb2, d795958abdd74e9aaa4aca0ba4eaef96; no voters:
I20260808 13:48:39.892007 22223 raft_consensus.cc:2804] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 13:48:39.892400 22223 raft_consensus.cc:493] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 13:48:39.892747 22223 raft_consensus.cc:3060] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96 [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:48:39.893898 22192 heartbeater.cc:499] Master 127.16.219.254:43775 was elected leader, sending a full tablet report...
I20260808 13:48:39.895152 22217 ts_tablet_manager.cc:1434] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294: Time spent starting tablet: real 0.049s user 0.015s sys 0.030s
I20260808 13:48:39.898634 22164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcd631b2887406584ce098a503f17d9" candidate_uuid: "d795958abdd74e9aaa4aca0ba4eaef96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" is_pre_election: true
I20260808 13:48:39.899359 22164 raft_consensus.cc:2468] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d795958abdd74e9aaa4aca0ba4eaef96 in term 0.
I20260808 13:48:39.901172 22223 raft_consensus.cc:515] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 } } peers { permanent_uuid: "d795958abdd74e9aaa4aca0ba4eaef96" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40131 } } peers { permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 } }
I20260808 13:48:39.903627 22223 leader_election.cc:290] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96 [CANDIDATE]: Term 1 election: Requested vote from peers 046f7c3632f446758ef8723338d9ecb2 (127.16.219.194:41369), bf06bf0eaa8b48daaeda6cff3ec6c294 (127.16.219.195:44219)
I20260808 13:48:39.903775 22080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcd631b2887406584ce098a503f17d9" candidate_uuid: "d795958abdd74e9aaa4aca0ba4eaef96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "046f7c3632f446758ef8723338d9ecb2"
I20260808 13:48:39.904361 22080 raft_consensus.cc:3060] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:48:39.905566 22164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcd631b2887406584ce098a503f17d9" candidate_uuid: "d795958abdd74e9aaa4aca0ba4eaef96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294"
I20260808 13:48:39.906142 22164 raft_consensus.cc:3060] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294 [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:48:39.911127 22080 raft_consensus.cc:2468] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d795958abdd74e9aaa4aca0ba4eaef96 in term 1.
I20260808 13:48:39.912165 21958 leader_election.cc:304] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 046f7c3632f446758ef8723338d9ecb2, d795958abdd74e9aaa4aca0ba4eaef96; no voters:
I20260808 13:48:39.912488 22164 raft_consensus.cc:2468] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d795958abdd74e9aaa4aca0ba4eaef96 in term 1.
I20260808 13:48:39.912858 22223 raft_consensus.cc:2804] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 13:48:39.913683 22223 raft_consensus.cc:697] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96 [term 1 LEADER]: Becoming Leader. State: Replica: d795958abdd74e9aaa4aca0ba4eaef96, State: Running, Role: LEADER
I20260808 13:48:39.914523 22223 consensus_queue.cc:237] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 } } peers { permanent_uuid: "d795958abdd74e9aaa4aca0ba4eaef96" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40131 } } peers { permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 } }
I20260808 13:48:39.922325 21885 catalog_manager.cc:5697] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96 reported cstate change: term changed from 0 to 1, leader changed from <none> to d795958abdd74e9aaa4aca0ba4eaef96 (127.16.219.193). New cstate: current_term: 1 leader_uuid: "d795958abdd74e9aaa4aca0ba4eaef96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 } } peers { permanent_uuid: "d795958abdd74e9aaa4aca0ba4eaef96" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40131 } } peers { permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 } } }
I20260808 13:48:40.212956 22070 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 13:48:40.213835 22154 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 13:48:40.214933 21986 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260808 13:48:40.326318 22223 consensus_queue.cc:1048] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 13:48:40.332192 22223 consensus_queue.cc:1048] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 13:48:40.408159 21961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.219.195:44219, user_credentials={real_user=slave}} blocked reactor thread for 56680.1us
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
c18223fc7b964846abd82f3b76b0fe9a | 127.16.219.254:43775 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
046f7c3632f446758ef8723338d9ecb2 | 127.16.219.194:41369 | HEALTHY | <none> | 0 | 0
bf06bf0eaa8b48daaeda6cff3ec6c294 | 127.16.219.195:44219 | HEALTHY | <none> | 0 | 0
d795958abdd74e9aaa4aca0ba4eaef96 | 127.16.219.193:40131 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
time_source | system_unsync | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
Tablet afcd631b2887406584ce098a503f17d9 of table 'test-workload' is conflicted: 2 replicas' active configs disagree with the leader master's
046f7c3632f446758ef8723338d9ecb2 (127.16.219.194:41369): RUNNING
d795958abdd74e9aaa4aca0ba4eaef96 (127.16.219.193:40131): RUNNING [LEADER]
bf06bf0eaa8b48daaeda6cff3ec6c294 (127.16.219.195:44219): RUNNING
All reported replicas are:
A = 046f7c3632f446758ef8723338d9ecb2
B = d795958abdd74e9aaa4aca0ba4eaef96
C = bf06bf0eaa8b48daaeda6cff3ec6c294
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
master | A B* C | | | Yes
A | A B C | 1 | -1 | Yes
B | A B* C | 1 | -1 | Yes
C | A B C | 1 | -1 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+--------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | CONSENSUS_MISMATCH | 1 | 0 | 0 | 0 | 1
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260808 13:48:40.497795 17263 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260808 13:48:40.866154 22070 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 13:48:40.866900 22154 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 13:48:40.876894 21986 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
c18223fc7b964846abd82f3b76b0fe9a | 127.16.219.254:43775 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
046f7c3632f446758ef8723338d9ecb2 | 127.16.219.194:41369 | HEALTHY | <none> | 0 | 0
bf06bf0eaa8b48daaeda6cff3ec6c294 | 127.16.219.195:44219 | HEALTHY | <none> | 0 | 0
d795958abdd74e9aaa4aca0ba4eaef96 | 127.16.219.193:40131 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
time_source | system_unsync | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
test-workload | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260808 13:48:41.079221 17263 log_verifier.cc:126] Checking tablet afcd631b2887406584ce098a503f17d9
I20260808 13:48:41.141513 17263 log_verifier.cc:177] Verified matching terms for 1 ops in tablet afcd631b2887406584ce098a503f17d9
I20260808 13:48:41.142164 17263 tablet_replica.cc:333] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96: stopping tablet replica
I20260808 13:48:41.142714 17263 raft_consensus.cc:2243] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96 [term 1 LEADER]: Raft consensus shutting down.
I20260808 13:48:41.143613 17263 raft_consensus.cc:2272] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:41.360738 22070 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 13:48:41.362113 22154 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 13:48:41.365091 21986 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
c18223fc7b964846abd82f3b76b0fe9a | 127.16.219.254:43775 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
046f7c3632f446758ef8723338d9ecb2 | 127.16.219.194:41369 | HEALTHY | <none> | 0 | 0
bf06bf0eaa8b48daaeda6cff3ec6c294 | 127.16.219.195:44219 | HEALTHY | <none> | 0 | 0
d795958abdd74e9aaa4aca0ba4eaef96 | 127.16.219.193:40131 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
time_source | system_unsync | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
Tablet afcd631b2887406584ce098a503f17d9 of table 'test-workload' is under-replicated: 1 replica(s) not RUNNING
046f7c3632f446758ef8723338d9ecb2 (127.16.219.194:41369): RUNNING
d795958abdd74e9aaa4aca0ba4eaef96 (127.16.219.193:40131): not running [LEADER]
State: FAILED
Data state: TABLET_DATA_READY
Last status: IO error: INJECTED ERROR: tablet failed
bf06bf0eaa8b48daaeda6cff3ec6c294 (127.16.219.195:44219): RUNNING
All reported replicas are:
A = 046f7c3632f446758ef8723338d9ecb2
B = d795958abdd74e9aaa4aca0ba4eaef96
C = bf06bf0eaa8b48daaeda6cff3ec6c294
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+------------------------+--------------+--------------+------------
master | A B* C | | | Yes
A | A B* C | 1 | -1 | Yes
B | [config not available] | | |
C | A B* C | 1 | -1 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | UNDER_REPLICATED | 1 | 0 | 0 | 1 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260808 13:48:41.586547 17263 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260808 13:48:41.956625 22070 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 13:48:41.964758 21986 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 13:48:41.964952 22154 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
c18223fc7b964846abd82f3b76b0fe9a | 127.16.219.254:43775 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
046f7c3632f446758ef8723338d9ecb2 | 127.16.219.194:41369 | HEALTHY | <none> | 0 | 0
bf06bf0eaa8b48daaeda6cff3ec6c294 | 127.16.219.195:44219 | HEALTHY | <none> | 0 | 0
d795958abdd74e9aaa4aca0ba4eaef96 | 127.16.219.193:40131 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
time_source | system_unsync | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
Tablet afcd631b2887406584ce098a503f17d9 of table 'test-workload' is under-replicated: 1 replica(s) not RUNNING
046f7c3632f446758ef8723338d9ecb2 (127.16.219.194:41369): RUNNING
d795958abdd74e9aaa4aca0ba4eaef96 (127.16.219.193:40131): not running [LEADER]
State: FAILED
Data state: TABLET_DATA_READY
Last status: IO error: INJECTED ERROR: tablet failed
bf06bf0eaa8b48daaeda6cff3ec6c294 (127.16.219.195:44219): RUNNING
All reported replicas are:
A = 046f7c3632f446758ef8723338d9ecb2
B = d795958abdd74e9aaa4aca0ba4eaef96
C = bf06bf0eaa8b48daaeda6cff3ec6c294
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+------------------------+--------------+--------------+------------
master | A B* C | | | Yes
A | A B* C | 1 | -1 | Yes
B | [config not available] | | |
C | A B* C | 1 | -1 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | UNDER_REPLICATED | 1 | 0 | 0 | 1 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260808 13:48:42.174147 17263 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260808 13:48:42.403334 22356 raft_consensus.cc:493] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d795958abdd74e9aaa4aca0ba4eaef96)
I20260808 13:48:42.403872 22356 raft_consensus.cc:515] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 } } peers { permanent_uuid: "d795958abdd74e9aaa4aca0ba4eaef96" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40131 } } peers { permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 } }
I20260808 13:48:42.406140 22356 leader_election.cc:290] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d795958abdd74e9aaa4aca0ba4eaef96 (127.16.219.193:40131), bf06bf0eaa8b48daaeda6cff3ec6c294 (127.16.219.195:44219)
I20260808 13:48:42.425467 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcd631b2887406584ce098a503f17d9" candidate_uuid: "046f7c3632f446758ef8723338d9ecb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d795958abdd74e9aaa4aca0ba4eaef96" is_pre_election: true
W20260808 13:48:42.428222 22044 leader_election.cc:343] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d795958abdd74e9aaa4aca0ba4eaef96 (127.16.219.193:40131): Illegal state: cannot vote while shut down
I20260808 13:48:42.429956 22365 raft_consensus.cc:493] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d795958abdd74e9aaa4aca0ba4eaef96)
I20260808 13:48:42.431454 22365 raft_consensus.cc:515] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 } } peers { permanent_uuid: "d795958abdd74e9aaa4aca0ba4eaef96" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40131 } } peers { permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 } }
I20260808 13:48:42.438026 22365 leader_election.cc:290] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 046f7c3632f446758ef8723338d9ecb2 (127.16.219.194:41369), d795958abdd74e9aaa4aca0ba4eaef96 (127.16.219.193:40131)
I20260808 13:48:42.439052 22164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcd631b2887406584ce098a503f17d9" candidate_uuid: "046f7c3632f446758ef8723338d9ecb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" is_pre_election: true
I20260808 13:48:42.439754 22164 raft_consensus.cc:2468] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 046f7c3632f446758ef8723338d9ecb2 in term 1.
I20260808 13:48:42.441156 22044 leader_election.cc:304] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 046f7c3632f446758ef8723338d9ecb2, bf06bf0eaa8b48daaeda6cff3ec6c294; no voters: d795958abdd74e9aaa4aca0ba4eaef96
I20260808 13:48:42.442989 22356 raft_consensus.cc:2804] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 13:48:42.443377 22356 raft_consensus.cc:493] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d795958abdd74e9aaa4aca0ba4eaef96)
I20260808 13:48:42.443749 22356 raft_consensus.cc:3060] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [term 1 FOLLOWER]: Advancing to term 2
I20260808 13:48:42.451992 22356 raft_consensus.cc:515] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 } } peers { permanent_uuid: "d795958abdd74e9aaa4aca0ba4eaef96" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40131 } } peers { permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 } }
I20260808 13:48:42.453553 22080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcd631b2887406584ce098a503f17d9" candidate_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "046f7c3632f446758ef8723338d9ecb2" is_pre_election: true
I20260808 13:48:42.454391 22080 raft_consensus.cc:2393] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf06bf0eaa8b48daaeda6cff3ec6c294 in current term 2: Already voted for candidate 046f7c3632f446758ef8723338d9ecb2 in this term.
I20260808 13:48:42.454941 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcd631b2887406584ce098a503f17d9" candidate_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d795958abdd74e9aaa4aca0ba4eaef96" is_pre_election: true
I20260808 13:48:42.455034 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcd631b2887406584ce098a503f17d9" candidate_uuid: "046f7c3632f446758ef8723338d9ecb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d795958abdd74e9aaa4aca0ba4eaef96"
I20260808 13:48:42.456482 22356 leader_election.cc:290] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [CANDIDATE]: Term 2 election: Requested vote from peers d795958abdd74e9aaa4aca0ba4eaef96 (127.16.219.193:40131), bf06bf0eaa8b48daaeda6cff3ec6c294 (127.16.219.195:44219)
W20260808 13:48:42.456650 22044 leader_election.cc:343] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer d795958abdd74e9aaa4aca0ba4eaef96 (127.16.219.193:40131): Illegal state: cannot vote while shut down
W20260808 13:48:42.456677 22128 leader_election.cc:343] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d795958abdd74e9aaa4aca0ba4eaef96 (127.16.219.193:40131): Illegal state: cannot vote while shut down
I20260808 13:48:42.457512 22128 leader_election.cc:304] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf06bf0eaa8b48daaeda6cff3ec6c294; no voters: 046f7c3632f446758ef8723338d9ecb2, d795958abdd74e9aaa4aca0ba4eaef96
I20260808 13:48:42.458317 22365 raft_consensus.cc:3060] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294 [term 1 FOLLOWER]: Advancing to term 2
I20260808 13:48:42.458606 22164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcd631b2887406584ce098a503f17d9" candidate_uuid: "046f7c3632f446758ef8723338d9ecb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294"
I20260808 13:48:42.466063 22365 raft_consensus.cc:2749] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 13:48:42.471172 22164 raft_consensus.cc:2468] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 046f7c3632f446758ef8723338d9ecb2 in term 2.
I20260808 13:48:42.473527 22044 leader_election.cc:304] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 046f7c3632f446758ef8723338d9ecb2, bf06bf0eaa8b48daaeda6cff3ec6c294; no voters: d795958abdd74e9aaa4aca0ba4eaef96
I20260808 13:48:42.474328 22356 raft_consensus.cc:2804] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 13:48:42.475610 22356 raft_consensus.cc:697] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [term 2 LEADER]: Becoming Leader. State: Replica: 046f7c3632f446758ef8723338d9ecb2, State: Running, Role: LEADER
I20260808 13:48:42.476354 22356 consensus_queue.cc:237] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 } } peers { permanent_uuid: "d795958abdd74e9aaa4aca0ba4eaef96" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40131 } } peers { permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 } }
I20260808 13:48:42.483163 21885 catalog_manager.cc:5697] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 reported cstate change: term changed from 1 to 2, leader changed from d795958abdd74e9aaa4aca0ba4eaef96 (127.16.219.193) to 046f7c3632f446758ef8723338d9ecb2 (127.16.219.194). New cstate: current_term: 2 leader_uuid: "046f7c3632f446758ef8723338d9ecb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 } } peers { permanent_uuid: "d795958abdd74e9aaa4aca0ba4eaef96" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40131 } } peers { permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 } } }
I20260808 13:48:42.661449 22070 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260808 13:48:42.666846 22154 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 13:48:42.667026 21986 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
c18223fc7b964846abd82f3b76b0fe9a | 127.16.219.254:43775 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
046f7c3632f446758ef8723338d9ecb2 | 127.16.219.194:41369 | HEALTHY | <none> | 1 | 0
bf06bf0eaa8b48daaeda6cff3ec6c294 | 127.16.219.195:44219 | HEALTHY | <none> | 0 | 0
d795958abdd74e9aaa4aca0ba4eaef96 | 127.16.219.193:40131 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
time_source | system_unsync | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
Tablet afcd631b2887406584ce098a503f17d9 of table 'test-workload' is under-replicated: 1 replica(s) not RUNNING
046f7c3632f446758ef8723338d9ecb2 (127.16.219.194:41369): RUNNING [LEADER]
d795958abdd74e9aaa4aca0ba4eaef96 (127.16.219.193:40131): not running
State: FAILED
Data state: TABLET_DATA_READY
Last status: IO error: INJECTED ERROR: tablet failed
bf06bf0eaa8b48daaeda6cff3ec6c294 (127.16.219.195:44219): RUNNING
All reported replicas are:
A = 046f7c3632f446758ef8723338d9ecb2
B = d795958abdd74e9aaa4aca0ba4eaef96
C = bf06bf0eaa8b48daaeda6cff3ec6c294
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+------------------------+--------------+--------------+------------
master | A* B C | | | Yes
A | A* B C | 2 | -1 | Yes
B | [config not available] | | |
C | A B C | 2 | -1 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | UNDER_REPLICATED | 1 | 0 | 0 | 1 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260808 13:48:42.877841 17263 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
W20260808 13:48:43.100841 22044 consensus_peers.cc:597] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 -> Peer d795958abdd74e9aaa4aca0ba4eaef96 (127.16.219.193:40131): Couldn't send request to peer d795958abdd74e9aaa4aca0ba4eaef96. Error code: TABLET_FAILED (20). Status: Illegal state: Tablet not RUNNING: FAILED: IO error: INJECTED ERROR: tablet failed. This is attempt 1: this message will repeat every 5th retry.
I20260808 13:48:43.104625 22164 raft_consensus.cc:1275] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294 [term 2 FOLLOWER]: Refusing update from remote peer 046f7c3632f446758ef8723338d9ecb2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260808 13:48:43.105926 22393 consensus_queue.cc:1048] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260808 13:48:43.440220 22070 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260808 13:48:43.440937 22154 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 13:48:43.450843 21986 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 13:48:43.483680 22393 raft_consensus.cc:1012] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2: Attempting to remove follower d795958abdd74e9aaa4aca0ba4eaef96 from the Raft config. Reason: The tablet replica hosted on peer d795958abdd74e9aaa4aca0ba4eaef96 has failed
I20260808 13:48:43.485960 22393 consensus_queue.cc:237] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 } } peers { permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 } }
I20260808 13:48:43.495061 22164 raft_consensus.cc:1275] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294 [term 2 FOLLOWER]: Refusing update from remote peer 046f7c3632f446758ef8723338d9ecb2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260808 13:48:43.496794 22393 consensus_queue.cc:1048] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260808 13:48:43.504230 22396 raft_consensus.cc:2955] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, VOTER d795958abdd74e9aaa4aca0ba4eaef96 (127.16.219.193) evicted. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 } } peers { permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 } } }
I20260808 13:48:43.506700 22163 raft_consensus.cc:2955] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, VOTER d795958abdd74e9aaa4aca0ba4eaef96 (127.16.219.193) evicted. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 } } peers { permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 } } }
I20260808 13:48:43.519407 21885 catalog_manager.cc:5697] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 reported cstate change: config changed from index -1 to 3, VOTER d795958abdd74e9aaa4aca0ba4eaef96 (127.16.219.193) evicted. New cstate: current_term: 2 leader_uuid: "046f7c3632f446758ef8723338d9ecb2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 } } peers { permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 } } }
I20260808 13:48:43.585821 22080 consensus_queue.cc:237] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 } } peers { permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 } } peers { permanent_uuid: "d795958abdd74e9aaa4aca0ba4eaef96" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40131 } }
I20260808 13:48:43.587821 21986 tablet_service.cc:1558] Processing DeleteTablet for tablet afcd631b2887406584ce098a503f17d9 with delete_type TABLET_DATA_TOMBSTONED (TS d795958abdd74e9aaa4aca0ba4eaef96 not found in new config with opid_index 3) from {username='slave'} at 127.0.0.1:53316
W20260808 13:48:43.599051 22044 consensus_peers.cc:597] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 -> Peer d795958abdd74e9aaa4aca0ba4eaef96 (127.16.219.193:40131): Couldn't send request to peer d795958abdd74e9aaa4aca0ba4eaef96. Error code: TABLET_FAILED (20). Status: Illegal state: Tablet not RUNNING: FAILED: IO error: INJECTED ERROR: tablet failed. This is attempt 1: this message will repeat every 5th retry.
I20260808 13:48:43.601047 22432 ts_tablet_manager.cc:1916] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260808 13:48:43.605332 22163 raft_consensus.cc:1275] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294 [term 2 FOLLOWER]: Refusing update from remote peer 046f7c3632f446758ef8723338d9ecb2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260808 13:48:43.607287 22396 consensus_queue.cc:1048] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260808 13:48:43.615659 22393 raft_consensus.cc:2955] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER d795958abdd74e9aaa4aca0ba4eaef96 (127.16.219.193) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 } } peers { permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 } } peers { permanent_uuid: "d795958abdd74e9aaa4aca0ba4eaef96" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40131 } } }
I20260808 13:48:43.622815 22163 raft_consensus.cc:2955] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER d795958abdd74e9aaa4aca0ba4eaef96 (127.16.219.193) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 } } peers { permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 } } peers { permanent_uuid: "d795958abdd74e9aaa4aca0ba4eaef96" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40131 } } }
I20260808 13:48:43.624315 22432 ts_tablet_manager.cc:1929] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260808 13:48:43.624794 22432 log.cc:1199] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96: Deleting WAL directory at /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_0.1786196858807110-17263-0/minicluster-data/ts-0-root/wals/afcd631b2887406584ce098a503f17d9
I20260808 13:48:43.626833 21874 catalog_manager.cc:5028] TS d795958abdd74e9aaa4aca0ba4eaef96 (127.16.219.193:40131): tablet afcd631b2887406584ce098a503f17d9 (table test-workload [id=e6a96488d5fa46a597f3fad3e86c919e]) successfully deleted
I20260808 13:48:43.646683 21872 catalog_manager.cc:5210] ChangeConfig:ADD_PEER:VOTER RPC for tablet afcd631b2887406584ce098a503f17d9 with cas_config_opid_index 3: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260808 13:48:43.640542 21885 catalog_manager.cc:5697] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294 reported cstate change: config changed from index 3 to 4, VOTER d795958abdd74e9aaa4aca0ba4eaef96 (127.16.219.193) added. New cstate: current_term: 2 leader_uuid: "046f7c3632f446758ef8723338d9ecb2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 } } peers { permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 } } peers { permanent_uuid: "d795958abdd74e9aaa4aca0ba4eaef96" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40131 } } }
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
c18223fc7b964846abd82f3b76b0fe9a | 127.16.219.254:43775 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
046f7c3632f446758ef8723338d9ecb2 | 127.16.219.194:41369 | HEALTHY | <none> | 1 | 0
bf06bf0eaa8b48daaeda6cff3ec6c294 | 127.16.219.195:44219 | HEALTHY | <none> | 0 | 0
d795958abdd74e9aaa4aca0ba4eaef96 | 127.16.219.193:40131 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
time_source | system_unsync | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
Tablet afcd631b2887406584ce098a503f17d9 of table 'test-workload' is under-replicated: 1 replica(s) not RUNNING
046f7c3632f446758ef8723338d9ecb2 (127.16.219.194:41369): RUNNING [LEADER]
d795958abdd74e9aaa4aca0ba4eaef96 (127.16.219.193:40131): not running
State: FAILED
Data state: TABLET_DATA_READY
Last status: IO error: INJECTED ERROR: tablet failed
bf06bf0eaa8b48daaeda6cff3ec6c294 (127.16.219.195:44219): RUNNING
All reported replicas are:
A = 046f7c3632f446758ef8723338d9ecb2
B = d795958abdd74e9aaa4aca0ba4eaef96
C = bf06bf0eaa8b48daaeda6cff3ec6c294
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+------------------------+--------------+--------------+------------
master | A* B C | | | Yes
A | A* B C | 2 | -1 | Yes
B | [config not available] | | |
C | A* B C | 2 | -1 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | UNDER_REPLICATED | 1 | 0 | 0 | 1 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260808 13:48:43.707165 17263 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260808 13:48:44.098028 22396 raft_consensus.cc:1012] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2: Attempting to remove follower d795958abdd74e9aaa4aca0ba4eaef96 from the Raft config. Reason: The tablet replica hosted on peer d795958abdd74e9aaa4aca0ba4eaef96 has failed
I20260808 13:48:44.100136 22396 consensus_queue.cc:237] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 } } peers { permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 } }
I20260808 13:48:44.103977 22163 raft_consensus.cc:1275] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294 [term 2 FOLLOWER]: Refusing update from remote peer 046f7c3632f446758ef8723338d9ecb2: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260808 13:48:44.105203 22434 consensus_queue.cc:1048] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260808 13:48:44.110351 22396 raft_consensus.cc:2955] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER d795958abdd74e9aaa4aca0ba4eaef96 (127.16.219.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 } } peers { permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 } } }
I20260808 13:48:44.111775 22163 raft_consensus.cc:2955] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER d795958abdd74e9aaa4aca0ba4eaef96 (127.16.219.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 } } peers { permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 } } }
I20260808 13:48:44.121007 21883 catalog_manager.cc:5697] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 reported cstate change: config changed from index 4 to 5, VOTER d795958abdd74e9aaa4aca0ba4eaef96 (127.16.219.193) evicted. New cstate: current_term: 2 leader_uuid: "046f7c3632f446758ef8723338d9ecb2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 } } peers { permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 } } }
I20260808 13:48:44.129714 21986 tablet_service.cc:1558] Processing DeleteTablet for tablet afcd631b2887406584ce098a503f17d9 with delete_type TABLET_DATA_TOMBSTONED (TS d795958abdd74e9aaa4aca0ba4eaef96 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:53316
I20260808 13:48:44.132083 21874 catalog_manager.cc:5028] TS d795958abdd74e9aaa4aca0ba4eaef96 (127.16.219.193:40131): tablet afcd631b2887406584ce098a503f17d9 (table test-workload [id=e6a96488d5fa46a597f3fad3e86c919e]) successfully deleted
I20260808 13:48:44.133167 22080 consensus_queue.cc:237] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 } } peers { permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 } } peers { permanent_uuid: "d795958abdd74e9aaa4aca0ba4eaef96" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40131 } }
I20260808 13:48:44.137707 22163 raft_consensus.cc:1275] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294 [term 2 FOLLOWER]: Refusing update from remote peer 046f7c3632f446758ef8723338d9ecb2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
W20260808 13:48:44.138021 22044 consensus_peers.cc:597] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 -> Peer d795958abdd74e9aaa4aca0ba4eaef96 (127.16.219.193:40131): Couldn't send request to peer d795958abdd74e9aaa4aca0ba4eaef96. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: FAILED. This is attempt 1: this message will repeat every 5th retry.
I20260808 13:48:44.138978 22396 consensus_queue.cc:1048] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260808 13:48:44.144037 22434 raft_consensus.cc:2955] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [term 2 LEADER]: Committing config change with OpId 2.6: config changed from index 5 to 6, VOTER d795958abdd74e9aaa4aca0ba4eaef96 (127.16.219.193) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 } } peers { permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 } } peers { permanent_uuid: "d795958abdd74e9aaa4aca0ba4eaef96" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40131 } } }
I20260808 13:48:44.145592 22163 raft_consensus.cc:2955] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294 [term 2 FOLLOWER]: Committing config change with OpId 2.6: config changed from index 5 to 6, VOTER d795958abdd74e9aaa4aca0ba4eaef96 (127.16.219.193) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 } } peers { permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 } } peers { permanent_uuid: "d795958abdd74e9aaa4aca0ba4eaef96" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40131 } } }
I20260808 13:48:44.151165 21872 catalog_manager.cc:5210] ChangeConfig:ADD_PEER:VOTER RPC for tablet afcd631b2887406584ce098a503f17d9 with cas_config_opid_index 5: ChangeConfig:ADD_PEER:VOTER succeeded (attempt 1)
I20260808 13:48:44.155020 21883 catalog_manager.cc:5697] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 reported cstate change: config changed from index 5 to 6, VOTER d795958abdd74e9aaa4aca0ba4eaef96 (127.16.219.193) added. New cstate: current_term: 2 leader_uuid: "046f7c3632f446758ef8723338d9ecb2" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 } } peers { permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 } } peers { permanent_uuid: "d795958abdd74e9aaa4aca0ba4eaef96" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40131 } } }
I20260808 13:48:44.435021 22070 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260808 13:48:44.435125 22154 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 13:48:44.436213 21986 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 13:48:44.772862 22466 ts_tablet_manager.cc:933] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96: Initiating tablet copy from peer 046f7c3632f446758ef8723338d9ecb2 (127.16.219.194:41369)
I20260808 13:48:44.785950 22466 tablet_copy_client.cc:323] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96: tablet copy: Beginning tablet copy session from remote peer at address 127.16.219.194:41369
I20260808 13:48:44.788028 22093 tablet_copy_service.cc:140] P 046f7c3632f446758ef8723338d9ecb2: Received BeginTabletCopySession request for tablet afcd631b2887406584ce098a503f17d9 from peer d795958abdd74e9aaa4aca0ba4eaef96 ({username='slave'} at 127.0.0.1:45408)
I20260808 13:48:44.788573 22093 tablet_copy_service.cc:161] P 046f7c3632f446758ef8723338d9ecb2: Beginning new tablet copy session on tablet afcd631b2887406584ce098a503f17d9 from peer d795958abdd74e9aaa4aca0ba4eaef96 at {username='slave'} at 127.0.0.1:45408: session id = d795958abdd74e9aaa4aca0ba4eaef96-afcd631b2887406584ce098a503f17d9
I20260808 13:48:44.796586 22093 tablet_copy_source_session.cc:215] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 13:48:44.799652 22466 ts_tablet_manager.cc:1916] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260808 13:48:44.816823 22466 ts_tablet_manager.cc:1929] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.1
I20260808 13:48:44.817691 22466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afcd631b2887406584ce098a503f17d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:48:44.824229 22466 tablet_copy_client.cc:806] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96: tablet copy: Starting download of 0 data blocks...
I20260808 13:48:44.824961 22466 tablet_copy_client.cc:670] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96: tablet copy: Starting download of 1 WAL segments...
I20260808 13:48:44.828629 22466 tablet_copy_client.cc:538] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 13:48:44.835515 22466 tablet_bootstrap.cc:492] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96: Bootstrap starting.
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
c18223fc7b964846abd82f3b76b0fe9a | 127.16.219.254:43775 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
046f7c3632f446758ef8723338d9ecb2 | 127.16.219.194:41369 | HEALTHY | <none> | 1 | 0
bf06bf0eaa8b48daaeda6cff3ec6c294 | 127.16.219.195:44219 | HEALTHY | <none> | 0 | 0
d795958abdd74e9aaa4aca0ba4eaef96 | 127.16.219.193:40131 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
time_source | system_unsync | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
Tablet afcd631b2887406584ce098a503f17d9 of table 'test-workload' is under-replicated: 1 replica(s) not RUNNING
046f7c3632f446758ef8723338d9ecb2 (127.16.219.194:41369): RUNNING [LEADER]
bf06bf0eaa8b48daaeda6cff3ec6c294 (127.16.219.195:44219): RUNNING
d795958abdd74e9aaa4aca0ba4eaef96 (127.16.219.193:40131): not running
State: FAILED
Data state: TABLET_DATA_TOMBSTONED
Last status: Deleted tablet blocks from disk
All reported replicas are:
A = 046f7c3632f446758ef8723338d9ecb2
B = bf06bf0eaa8b48daaeda6cff3ec6c294
C = d795958abdd74e9aaa4aca0ba4eaef96
I20260808 13:48:44.860213 22466 tablet_bootstrap.cc:492] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+------------------------+--------------+--------------+------------
master | A* B C | | | Yes
A | A* B C | 2 | 6 | Yes
B | A* B C | 2 | 6 | Yes
C | [config not available] | | |
I20260808 13:48:44.861217 22466 tablet_bootstrap.cc:492] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96: Bootstrap complete.
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | UNDER_REPLICATED | 1 | 0 | 0 | 1 | 0
I20260808 13:48:44.862036 22466 ts_tablet_manager.cc:1403] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96: Time spent bootstrapping tablet: real 0.027s user 0.023s sys 0.000s
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260808 13:48:44.867406 17263 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260808 13:48:44.865840 22466 raft_consensus.cc:359] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 } } peers { permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 } } peers { permanent_uuid: "d795958abdd74e9aaa4aca0ba4eaef96" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40131 } }
I20260808 13:48:44.869030 22466 raft_consensus.cc:740] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d795958abdd74e9aaa4aca0ba4eaef96, State: Initialized, Role: FOLLOWER
I20260808 13:48:44.869930 22466 consensus_queue.cc:260] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 2.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "046f7c3632f446758ef8723338d9ecb2" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41369 } } peers { permanent_uuid: "bf06bf0eaa8b48daaeda6cff3ec6c294" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 44219 } } peers { permanent_uuid: "d795958abdd74e9aaa4aca0ba4eaef96" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 40131 } }
I20260808 13:48:44.871922 22466 ts_tablet_manager.cc:1434] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260808 13:48:44.873605 22093 tablet_copy_service.cc:342] P 046f7c3632f446758ef8723338d9ecb2: Request end of tablet copy session d795958abdd74e9aaa4aca0ba4eaef96-afcd631b2887406584ce098a503f17d9 received from {username='slave'} at 127.0.0.1:45408
I20260808 13:48:44.873943 22093 tablet_copy_service.cc:434] P 046f7c3632f446758ef8723338d9ecb2: ending tablet copy session d795958abdd74e9aaa4aca0ba4eaef96-afcd631b2887406584ce098a503f17d9 on tablet afcd631b2887406584ce098a503f17d9 with peer d795958abdd74e9aaa4aca0ba4eaef96
I20260808 13:48:45.255396 21996 raft_consensus.cc:1217] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96 [term 2 FOLLOWER]: Deduplicated request from leader. Original: 2.5->[2.6-2.6] Dedup: 2.6->[]
W20260808 13:48:45.597111 21920 debug-util.cc:398] Leaking SignalData structure 0x7b08000f7660 after lost signal to thread 17266
W20260808 13:48:45.598260 21920 debug-util.cc:398] Leaking SignalData structure 0x7b08000ba0e0 after lost signal to thread 21923
W20260808 13:48:45.599359 21920 debug-util.cc:398] Leaking SignalData structure 0x7b08001e6dc0 after lost signal to thread 22025
W20260808 13:48:45.600332 21920 debug-util.cc:398] Leaking SignalData structure 0x7b080023dda0 after lost signal to thread 22111
W20260808 13:48:45.601259 21920 debug-util.cc:398] Leaking SignalData structure 0x7b080006cee0 after lost signal to thread 22191
I20260808 13:48:45.889827 22070 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260808 13:48:45.892508 22154 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 13:48:45.902551 21986 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
c18223fc7b964846abd82f3b76b0fe9a | 127.16.219.254:43775 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
046f7c3632f446758ef8723338d9ecb2 | 127.16.219.194:41369 | HEALTHY | <none> | 1 | 0
bf06bf0eaa8b48daaeda6cff3ec6c294 | 127.16.219.195:44219 | HEALTHY | <none> | 0 | 0
d795958abdd74e9aaa4aca0ba4eaef96 | 127.16.219.193:40131 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-------+-----------------------+-------------------------
raft_prepare_replacement_before_eviction | false | experimental,advanced | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 3 server(s) checked
time_source | system_unsync | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
test-workload | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 1
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260808 13:48:46.162631 17263 log_verifier.cc:126] Checking tablet afcd631b2887406584ce098a503f17d9
I20260808 13:48:46.281333 17263 log_verifier.cc:177] Verified matching terms for 6 ops in tablet afcd631b2887406584ce098a503f17d9
I20260808 13:48:46.284641 17263 tablet_server.cc:179] TabletServer@127.16.219.193:0 shutting down...
I20260808 13:48:46.322700 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 13:48:46.323482 17263 tablet_replica.cc:333] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96: stopping tablet replica
I20260808 13:48:46.324234 17263 raft_consensus.cc:2243] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260808 13:48:46.324798 17263 raft_consensus.cc:2272] T afcd631b2887406584ce098a503f17d9 P d795958abdd74e9aaa4aca0ba4eaef96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:46.348783 17263 tablet_server.cc:196] TabletServer@127.16.219.193:0 shutdown complete.
I20260808 13:48:46.363940 17263 tablet_server.cc:179] TabletServer@127.16.219.194:0 shutting down...
I20260808 13:48:46.394026 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 13:48:46.394708 17263 tablet_replica.cc:333] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2: stopping tablet replica
I20260808 13:48:46.395256 17263 raft_consensus.cc:2243] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [term 2 LEADER]: Raft consensus shutting down.
I20260808 13:48:46.396100 17263 raft_consensus.cc:2272] T afcd631b2887406584ce098a503f17d9 P 046f7c3632f446758ef8723338d9ecb2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:46.417629 17263 tablet_server.cc:196] TabletServer@127.16.219.194:0 shutdown complete.
I20260808 13:48:46.432040 17263 tablet_server.cc:179] TabletServer@127.16.219.195:0 shutting down...
I20260808 13:48:46.459930 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 13:48:46.460717 17263 tablet_replica.cc:333] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294: stopping tablet replica
I20260808 13:48:46.461408 17263 raft_consensus.cc:2243] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260808 13:48:46.462242 17263 raft_consensus.cc:2272] T afcd631b2887406584ce098a503f17d9 P bf06bf0eaa8b48daaeda6cff3ec6c294 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:46.485652 17263 tablet_server.cc:196] TabletServer@127.16.219.195:0 shutdown complete.
I20260808 13:48:46.499959 17263 master.cc:562] Master@127.16.219.254:43775 shutting down...
I20260808 13:48:46.529814 17263 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c18223fc7b964846abd82f3b76b0fe9a [term 1 LEADER]: Raft consensus shutting down.
I20260808 13:48:46.530396 17263 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c18223fc7b964846abd82f3b76b0fe9a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:46.530740 17263 tablet_replica.cc:333] T 00000000000000000000000000000000 P c18223fc7b964846abd82f3b76b0fe9a: stopping tablet replica
W20260808 13:48:47.547078 17263 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 21920)
W20260808 13:48:48.547544 17263 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 21920)
I20260808 13:48:49.026436 17263 master.cc:584] Master@127.16.219.254:43775 shutdown complete.
[ OK ] FailedTabletsAreReplacedITest.OneReplica/0 (9959 ms)
[ RUN ] FailedTabletsAreReplacedITest.OneReplica/1
I20260808 13:48:49.058032 17263 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.219.254:35141
I20260808 13:48:49.059154 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:48:49.064458 22507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:49.066149 22509 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:49.066776 22511 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:48:49.067186 17263 server_base.cc:1061] running on GCE node
I20260808 13:48:49.069798 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:48:49.069998 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:48:49.070338 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196929070304 us; error 0 us; skew 500 ppm
I20260808 13:48:49.070871 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:48:49.072962 17263 webserver.cc:533] Webserver started at http://127.16.219.254:40117/ using document root <none> and password file <none>
I20260808 13:48:49.073421 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:48:49.073601 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:48:49.073908 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:48:49.075058 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786196858807110-17263-0/minicluster-data/master-0-root/instance:
uuid: "cd7908969be44016b87776d513871c3b"
format_stamp: "Formatted at 2026-08-08 13:48:49 on dist-test-slave-mn4r"
I20260808 13:48:49.079358 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 13:48:49.082690 22516 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:49.083571 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 13:48:49.083801 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786196858807110-17263-0/minicluster-data/master-0-root
uuid: "cd7908969be44016b87776d513871c3b"
format_stamp: "Formatted at 2026-08-08 13:48:49 on dist-test-slave-mn4r"
I20260808 13:48:49.084039 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786196858807110-17263-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786196858807110-17263-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786196858807110-17263-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:48:49.102452 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:48:49.103541 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:48:49.142755 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.254:35141
I20260808 13:48:49.142865 22568 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.254:35141 every 8 connection(s)
I20260808 13:48:49.146622 22569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:48:49.157176 22569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd7908969be44016b87776d513871c3b: Bootstrap starting.
I20260808 13:48:49.162251 22569 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd7908969be44016b87776d513871c3b: Neither blocks nor log segments found. Creating new log.
I20260808 13:48:49.166363 22569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd7908969be44016b87776d513871c3b: No bootstrap required, opened a new log
I20260808 13:48:49.168485 22569 raft_consensus.cc:359] T 00000000000000000000000000000000 P cd7908969be44016b87776d513871c3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd7908969be44016b87776d513871c3b" member_type: VOTER }
I20260808 13:48:49.168893 22569 raft_consensus.cc:385] T 00000000000000000000000000000000 P cd7908969be44016b87776d513871c3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:48:49.169116 22569 raft_consensus.cc:740] T 00000000000000000000000000000000 P cd7908969be44016b87776d513871c3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd7908969be44016b87776d513871c3b, State: Initialized, Role: FOLLOWER
I20260808 13:48:49.169687 22569 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd7908969be44016b87776d513871c3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd7908969be44016b87776d513871c3b" member_type: VOTER }
I20260808 13:48:49.170188 22569 raft_consensus.cc:399] T 00000000000000000000000000000000 P cd7908969be44016b87776d513871c3b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 13:48:49.170437 22569 raft_consensus.cc:493] T 00000000000000000000000000000000 P cd7908969be44016b87776d513871c3b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 13:48:49.170701 22569 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cd7908969be44016b87776d513871c3b [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:48:49.175321 22569 raft_consensus.cc:515] T 00000000000000000000000000000000 P cd7908969be44016b87776d513871c3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd7908969be44016b87776d513871c3b" member_type: VOTER }
I20260808 13:48:49.175846 22569 leader_election.cc:304] T 00000000000000000000000000000000 P cd7908969be44016b87776d513871c3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd7908969be44016b87776d513871c3b; no voters:
I20260808 13:48:49.177044 22569 leader_election.cc:290] T 00000000000000000000000000000000 P cd7908969be44016b87776d513871c3b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 13:48:49.177424 22572 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cd7908969be44016b87776d513871c3b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 13:48:49.178900 22572 raft_consensus.cc:697] T 00000000000000000000000000000000 P cd7908969be44016b87776d513871c3b [term 1 LEADER]: Becoming Leader. State: Replica: cd7908969be44016b87776d513871c3b, State: Running, Role: LEADER
I20260808 13:48:49.179584 22572 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd7908969be44016b87776d513871c3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd7908969be44016b87776d513871c3b" member_type: VOTER }
I20260808 13:48:49.180073 22569 sys_catalog.cc:565] T 00000000000000000000000000000000 P cd7908969be44016b87776d513871c3b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 13:48:49.184824 22573 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd7908969be44016b87776d513871c3b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cd7908969be44016b87776d513871c3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd7908969be44016b87776d513871c3b" member_type: VOTER } }
I20260808 13:48:49.185019 22574 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd7908969be44016b87776d513871c3b [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd7908969be44016b87776d513871c3b. Latest consensus state: current_term: 1 leader_uuid: "cd7908969be44016b87776d513871c3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd7908969be44016b87776d513871c3b" member_type: VOTER } }
I20260808 13:48:49.185616 22573 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd7908969be44016b87776d513871c3b [sys.catalog]: This master's current role is: LEADER
I20260808 13:48:49.185792 22574 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd7908969be44016b87776d513871c3b [sys.catalog]: This master's current role is: LEADER
I20260808 13:48:49.188885 22580 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260808 13:48:49.193646 22580 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260808 13:48:49.197664 17263 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260808 13:48:49.202621 22580 catalog_manager.cc:1383] Generated new cluster ID: f0fe8f873855494289b74171667a05e8
I20260808 13:48:49.202857 22580 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260808 13:48:49.221465 22580 catalog_manager.cc:1406] Generated new certificate authority record
I20260808 13:48:49.222826 22580 catalog_manager.cc:1540] Loading token signing keys...
I20260808 13:48:49.238958 22580 catalog_manager.cc:6070] T 00000000000000000000000000000000 P cd7908969be44016b87776d513871c3b: Generated new TSK 0
I20260808 13:48:49.239482 22580 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260808 13:48:49.263916 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:48:49.269924 22595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:49.271212 22596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:49.272737 22599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:48:49.273262 17263 server_base.cc:1061] running on GCE node
I20260808 13:48:49.274260 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:48:49.274466 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:48:49.274636 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196929274619 us; error 0 us; skew 500 ppm
I20260808 13:48:49.275194 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:48:49.277427 17263 webserver.cc:533] Webserver started at http://127.16.219.193:44315/ using document root <none> and password file <none>
I20260808 13:48:49.277925 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:48:49.278151 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:48:49.278431 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:48:49.279490 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786196858807110-17263-0/minicluster-data/ts-0-root/instance:
uuid: "47ba25b4ba0b433a84561b9d0682b045"
format_stamp: "Formatted at 2026-08-08 13:48:49 on dist-test-slave-mn4r"
I20260808 13:48:49.284073 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260808 13:48:49.287431 22604 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:49.288174 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 13:48:49.288460 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786196858807110-17263-0/minicluster-data/ts-0-root
uuid: "47ba25b4ba0b433a84561b9d0682b045"
format_stamp: "Formatted at 2026-08-08 13:48:49 on dist-test-slave-mn4r"
I20260808 13:48:49.288724 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786196858807110-17263-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786196858807110-17263-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786196858807110-17263-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:48:49.301188 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:48:49.302300 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:48:49.303651 17263 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 13:48:49.305771 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 13:48:49.305972 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:49.306223 17263 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 13:48:49.306385 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:49.348459 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.193:44531
I20260808 13:48:49.348644 22673 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.193:44531 every 8 connection(s)
I20260808 13:48:49.354223 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:48:49.363018 22678 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:49.363334 22679 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:49.368516 22681 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:48:49.371341 22674 heartbeater.cc:344] Connected to a master server at 127.16.219.254:35141
I20260808 13:48:49.371824 22674 heartbeater.cc:461] Registering TS with master...
I20260808 13:48:49.372557 22674 heartbeater.cc:507] Master 127.16.219.254:35141 requested a full tablet report, sending...
I20260808 13:48:49.395562 17263 server_base.cc:1061] running on GCE node
I20260808 13:48:49.399777 22533 ts_manager.cc:194] Registered new tserver with Master: 47ba25b4ba0b433a84561b9d0682b045 (127.16.219.193:44531)
I20260808 13:48:49.399899 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:48:49.400365 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:48:49.400655 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196929400631 us; error 0 us; skew 500 ppm
I20260808 13:48:49.401734 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:48:49.403146 22533 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54890
I20260808 13:48:49.406164 17263 webserver.cc:533] Webserver started at http://127.16.219.194:33479/ using document root <none> and password file <none>
I20260808 13:48:49.407073 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:48:49.407351 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:48:49.407836 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:48:49.409468 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786196858807110-17263-0/minicluster-data/ts-1-root/instance:
uuid: "131c311069234c598921039051019fb1"
format_stamp: "Formatted at 2026-08-08 13:48:49 on dist-test-slave-mn4r"
I20260808 13:48:49.414615 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20260808 13:48:49.418426 22687 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:49.419227 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 13:48:49.419468 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786196858807110-17263-0/minicluster-data/ts-1-root
uuid: "131c311069234c598921039051019fb1"
format_stamp: "Formatted at 2026-08-08 13:48:49 on dist-test-slave-mn4r"
I20260808 13:48:49.419732 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786196858807110-17263-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786196858807110-17263-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786196858807110-17263-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:48:49.448942 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:48:49.450318 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:48:49.451872 17263 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 13:48:49.454483 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 13:48:49.454689 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:49.454967 17263 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 13:48:49.455134 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:49.499747 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.194:41077
I20260808 13:48:49.499882 22754 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.194:41077 every 8 connection(s)
I20260808 13:48:49.506758 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:48:49.521129 22759 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:49.522361 22758 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:48:49.523325 22755 heartbeater.cc:344] Connected to a master server at 127.16.219.254:35141
I20260808 13:48:49.523804 22755 heartbeater.cc:461] Registering TS with master...
I20260808 13:48:49.524916 22755 heartbeater.cc:507] Master 127.16.219.254:35141 requested a full tablet report, sending...
I20260808 13:48:49.528475 22533 ts_manager.cc:194] Registered new tserver with Master: 131c311069234c598921039051019fb1 (127.16.219.194:41077)
W20260808 13:48:49.530548 22761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:48:49.530705 22533 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54896
I20260808 13:48:49.532727 17263 server_base.cc:1061] running on GCE node
I20260808 13:48:49.533856 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:48:49.534202 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:48:49.534449 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196929534429 us; error 0 us; skew 500 ppm
I20260808 13:48:49.535174 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:48:49.538349 17263 webserver.cc:533] Webserver started at http://127.16.219.195:33561/ using document root <none> and password file <none>
I20260808 13:48:49.539022 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:48:49.539274 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:48:49.539664 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:48:49.541592 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786196858807110-17263-0/minicluster-data/ts-2-root/instance:
uuid: "06a362692a3f4934afd6feb1b036a420"
format_stamp: "Formatted at 2026-08-08 13:48:49 on dist-test-slave-mn4r"
I20260808 13:48:49.548960 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.004s sys 0.002s
I20260808 13:48:49.553975 22766 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:49.554989 17263 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 13:48:49.555333 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786196858807110-17263-0/minicluster-data/ts-2-root
uuid: "06a362692a3f4934afd6feb1b036a420"
format_stamp: "Formatted at 2026-08-08 13:48:49 on dist-test-slave-mn4r"
I20260808 13:48:49.555627 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786196858807110-17263-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786196858807110-17263-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786196858807110-17263-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:48:49.573554 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:48:49.574903 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:48:49.576388 17263 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 13:48:49.578666 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 13:48:49.578910 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:49.579147 17263 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 13:48:49.579314 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:49.623570 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.195:45623
I20260808 13:48:49.623675 22832 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.195:45623 every 8 connection(s)
I20260808 13:48:49.628957 17263 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260808 13:48:49.637146 22836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:49.638139 22837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 13:48:49.640967 22839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 13:48:49.642539 17263 server_base.cc:1061] running on GCE node
I20260808 13:48:49.643098 22833 heartbeater.cc:344] Connected to a master server at 127.16.219.254:35141
I20260808 13:48:49.643491 22833 heartbeater.cc:461] Registering TS with master...
I20260808 13:48:49.643553 17263 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260808 13:48:49.643877 17263 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260808 13:48:49.644060 17263 hybrid_clock.cc:648] HybridClock initialized: now 1786196929644044 us; error 0 us; skew 500 ppm
I20260808 13:48:49.644413 22833 heartbeater.cc:507] Master 127.16.219.254:35141 requested a full tablet report, sending...
I20260808 13:48:49.644739 17263 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 13:48:49.646853 22533 ts_manager.cc:194] Registered new tserver with Master: 06a362692a3f4934afd6feb1b036a420 (127.16.219.195:45623)
I20260808 13:48:49.647745 17263 webserver.cc:533] Webserver started at http://127.16.219.196:45561/ using document root <none> and password file <none>
I20260808 13:48:49.648435 17263 fs_manager.cc:362] Metadata directory not provided
I20260808 13:48:49.648671 17263 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 13:48:49.648774 22533 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54906
I20260808 13:48:49.649041 17263 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 13:48:49.650571 17263 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786196858807110-17263-0/minicluster-data/ts-3-root/instance:
uuid: "bea3f7c0d9af4294affd324f66b23cd4"
format_stamp: "Formatted at 2026-08-08 13:48:49 on dist-test-slave-mn4r"
I20260808 13:48:49.655259 17263 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260808 13:48:49.658912 22844 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:49.659675 17263 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 13:48:49.659960 17263 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786196858807110-17263-0/minicluster-data/ts-3-root
uuid: "bea3f7c0d9af4294affd324f66b23cd4"
format_stamp: "Formatted at 2026-08-08 13:48:49 on dist-test-slave-mn4r"
I20260808 13:48:49.660264 17263 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786196858807110-17263-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786196858807110-17263-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786196858807110-17263-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 13:48:49.671370 17263 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260808 13:48:49.672559 17263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 13:48:49.673820 17263 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260808 13:48:49.676151 17263 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 13:48:49.676373 17263 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:49.676614 17263 ts_tablet_manager.cc:616] Registered 0 tablets
I20260808 13:48:49.676800 17263 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 13:48:49.720700 17263 rpc_server.cc:307] RPC server started. Bound to: 127.16.219.196:39383
I20260808 13:48:49.720916 22914 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.219.196:39383 every 8 connection(s)
I20260808 13:48:49.735381 22915 heartbeater.cc:344] Connected to a master server at 127.16.219.254:35141
I20260808 13:48:49.735731 22915 heartbeater.cc:461] Registering TS with master...
I20260808 13:48:49.736547 22915 heartbeater.cc:507] Master 127.16.219.254:35141 requested a full tablet report, sending...
I20260808 13:48:49.739244 22533 ts_manager.cc:194] Registered new tserver with Master: bea3f7c0d9af4294affd324f66b23cd4 (127.16.219.196:39383)
I20260808 13:48:49.740123 17263 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.015997775s
I20260808 13:48:49.741494 22533 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54908
I20260808 13:48:49.783481 22533 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54916:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 13:48:49.841984 22796 tablet_service.cc:1511] Processing CreateTablet for tablet 7e28bad139ad4517b82f963963a6b83c (DEFAULT_TABLE table=test-workload [id=988ceba10f7b43a6b351f000dc276b45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 13:48:49.843719 22796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e28bad139ad4517b82f963963a6b83c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:48:49.843997 22636 tablet_service.cc:1511] Processing CreateTablet for tablet 7e28bad139ad4517b82f963963a6b83c (DEFAULT_TABLE table=test-workload [id=988ceba10f7b43a6b351f000dc276b45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 13:48:49.845363 22636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e28bad139ad4517b82f963963a6b83c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:48:49.847451 22715 tablet_service.cc:1511] Processing CreateTablet for tablet 7e28bad139ad4517b82f963963a6b83c (DEFAULT_TABLE table=test-workload [id=988ceba10f7b43a6b351f000dc276b45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 13:48:49.848867 22715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e28bad139ad4517b82f963963a6b83c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:48:49.865793 22939 tablet_bootstrap.cc:492] T 7e28bad139ad4517b82f963963a6b83c P 47ba25b4ba0b433a84561b9d0682b045: Bootstrap starting.
I20260808 13:48:49.867825 22940 tablet_bootstrap.cc:492] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420: Bootstrap starting.
I20260808 13:48:49.870090 22941 tablet_bootstrap.cc:492] T 7e28bad139ad4517b82f963963a6b83c P 131c311069234c598921039051019fb1: Bootstrap starting.
I20260808 13:48:49.875835 22940 tablet_bootstrap.cc:654] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420: Neither blocks nor log segments found. Creating new log.
I20260808 13:48:49.875116 22939 tablet_bootstrap.cc:654] T 7e28bad139ad4517b82f963963a6b83c P 47ba25b4ba0b433a84561b9d0682b045: Neither blocks nor log segments found. Creating new log.
I20260808 13:48:49.876219 22941 tablet_bootstrap.cc:654] T 7e28bad139ad4517b82f963963a6b83c P 131c311069234c598921039051019fb1: Neither blocks nor log segments found. Creating new log.
I20260808 13:48:49.881872 22941 tablet_bootstrap.cc:492] T 7e28bad139ad4517b82f963963a6b83c P 131c311069234c598921039051019fb1: No bootstrap required, opened a new log
I20260808 13:48:49.882038 22940 tablet_bootstrap.cc:492] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420: No bootstrap required, opened a new log
I20260808 13:48:49.882438 22941 ts_tablet_manager.cc:1403] T 7e28bad139ad4517b82f963963a6b83c P 131c311069234c598921039051019fb1: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.004s
I20260808 13:48:49.882552 22940 ts_tablet_manager.cc:1403] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.006s
I20260808 13:48:49.882740 22939 tablet_bootstrap.cc:492] T 7e28bad139ad4517b82f963963a6b83c P 47ba25b4ba0b433a84561b9d0682b045: No bootstrap required, opened a new log
I20260808 13:48:49.883286 22939 ts_tablet_manager.cc:1403] T 7e28bad139ad4517b82f963963a6b83c P 47ba25b4ba0b433a84561b9d0682b045: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.008s
I20260808 13:48:49.885411 22940 raft_consensus.cc:359] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a362692a3f4934afd6feb1b036a420" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 45623 } } peers { permanent_uuid: "47ba25b4ba0b433a84561b9d0682b045" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 44531 } } peers { permanent_uuid: "131c311069234c598921039051019fb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41077 } }
I20260808 13:48:49.885869 22941 raft_consensus.cc:359] T 7e28bad139ad4517b82f963963a6b83c P 131c311069234c598921039051019fb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a362692a3f4934afd6feb1b036a420" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 45623 } } peers { permanent_uuid: "47ba25b4ba0b433a84561b9d0682b045" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 44531 } } peers { permanent_uuid: "131c311069234c598921039051019fb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41077 } }
I20260808 13:48:49.886360 22940 raft_consensus.cc:385] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:48:49.886693 22941 raft_consensus.cc:385] T 7e28bad139ad4517b82f963963a6b83c P 131c311069234c598921039051019fb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:48:49.886458 22939 raft_consensus.cc:359] T 7e28bad139ad4517b82f963963a6b83c P 47ba25b4ba0b433a84561b9d0682b045 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a362692a3f4934afd6feb1b036a420" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 45623 } } peers { permanent_uuid: "47ba25b4ba0b433a84561b9d0682b045" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 44531 } } peers { permanent_uuid: "131c311069234c598921039051019fb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41077 } }
I20260808 13:48:49.886786 22940 raft_consensus.cc:740] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a362692a3f4934afd6feb1b036a420, State: Initialized, Role: FOLLOWER
I20260808 13:48:49.887210 22941 raft_consensus.cc:740] T 7e28bad139ad4517b82f963963a6b83c P 131c311069234c598921039051019fb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 131c311069234c598921039051019fb1, State: Initialized, Role: FOLLOWER
I20260808 13:48:49.887297 22939 raft_consensus.cc:385] T 7e28bad139ad4517b82f963963a6b83c P 47ba25b4ba0b433a84561b9d0682b045 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 13:48:49.887758 22939 raft_consensus.cc:740] T 7e28bad139ad4517b82f963963a6b83c P 47ba25b4ba0b433a84561b9d0682b045 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47ba25b4ba0b433a84561b9d0682b045, State: Initialized, Role: FOLLOWER
I20260808 13:48:49.887825 22940 consensus_queue.cc:260] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a362692a3f4934afd6feb1b036a420" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 45623 } } peers { permanent_uuid: "47ba25b4ba0b433a84561b9d0682b045" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 44531 } } peers { permanent_uuid: "131c311069234c598921039051019fb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41077 } }
I20260808 13:48:49.888141 22941 consensus_queue.cc:260] T 7e28bad139ad4517b82f963963a6b83c P 131c311069234c598921039051019fb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a362692a3f4934afd6feb1b036a420" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 45623 } } peers { permanent_uuid: "47ba25b4ba0b433a84561b9d0682b045" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 44531 } } peers { permanent_uuid: "131c311069234c598921039051019fb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41077 } }
I20260808 13:48:49.888685 22939 consensus_queue.cc:260] T 7e28bad139ad4517b82f963963a6b83c P 47ba25b4ba0b433a84561b9d0682b045 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a362692a3f4934afd6feb1b036a420" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 45623 } } peers { permanent_uuid: "47ba25b4ba0b433a84561b9d0682b045" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 44531 } } peers { permanent_uuid: "131c311069234c598921039051019fb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41077 } }
I20260808 13:48:49.897238 22833 heartbeater.cc:499] Master 127.16.219.254:35141 was elected leader, sending a full tablet report...
I20260808 13:48:49.898449 22940 ts_tablet_manager.cc:1434] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420: Time spent starting tablet: real 0.015s user 0.004s sys 0.010s
I20260808 13:48:49.900899 22674 heartbeater.cc:499] Master 127.16.219.254:35141 was elected leader, sending a full tablet report...
I20260808 13:48:49.901262 22939 ts_tablet_manager.cc:1434] T 7e28bad139ad4517b82f963963a6b83c P 47ba25b4ba0b433a84561b9d0682b045: Time spent starting tablet: real 0.018s user 0.011s sys 0.006s
I20260808 13:48:49.900930 22755 heartbeater.cc:499] Master 127.16.219.254:35141 was elected leader, sending a full tablet report...
I20260808 13:48:49.902842 22941 ts_tablet_manager.cc:1434] T 7e28bad139ad4517b82f963963a6b83c P 131c311069234c598921039051019fb1: Time spent starting tablet: real 0.020s user 0.013s sys 0.004s
I20260808 13:48:50.110741 22946 raft_consensus.cc:493] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 13:48:50.111318 22946 raft_consensus.cc:515] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a362692a3f4934afd6feb1b036a420" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 45623 } } peers { permanent_uuid: "47ba25b4ba0b433a84561b9d0682b045" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 44531 } } peers { permanent_uuid: "131c311069234c598921039051019fb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41077 } }
I20260808 13:48:50.113444 22946 leader_election.cc:290] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47ba25b4ba0b433a84561b9d0682b045 (127.16.219.193:44531), 131c311069234c598921039051019fb1 (127.16.219.194:41077)
I20260808 13:48:50.122833 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28bad139ad4517b82f963963a6b83c" candidate_uuid: "06a362692a3f4934afd6feb1b036a420" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ba25b4ba0b433a84561b9d0682b045" is_pre_election: true
I20260808 13:48:50.123708 22647 raft_consensus.cc:2468] T 7e28bad139ad4517b82f963963a6b83c P 47ba25b4ba0b433a84561b9d0682b045 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a362692a3f4934afd6feb1b036a420 in term 0.
I20260808 13:48:50.123718 22726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28bad139ad4517b82f963963a6b83c" candidate_uuid: "06a362692a3f4934afd6feb1b036a420" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131c311069234c598921039051019fb1" is_pre_election: true
I20260808 13:48:50.124450 22726 raft_consensus.cc:2468] T 7e28bad139ad4517b82f963963a6b83c P 131c311069234c598921039051019fb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06a362692a3f4934afd6feb1b036a420 in term 0.
I20260808 13:48:50.125036 22767 leader_election.cc:304] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a362692a3f4934afd6feb1b036a420, 47ba25b4ba0b433a84561b9d0682b045; no voters:
I20260808 13:48:50.125900 22946 raft_consensus.cc:2804] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 13:48:50.126272 22946 raft_consensus.cc:493] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 13:48:50.126492 22946 raft_consensus.cc:3060] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:48:50.132653 22946 raft_consensus.cc:515] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a362692a3f4934afd6feb1b036a420" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 45623 } } peers { permanent_uuid: "47ba25b4ba0b433a84561b9d0682b045" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 44531 } } peers { permanent_uuid: "131c311069234c598921039051019fb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41077 } }
I20260808 13:48:50.134291 22946 leader_election.cc:290] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 [CANDIDATE]: Term 1 election: Requested vote from peers 47ba25b4ba0b433a84561b9d0682b045 (127.16.219.193:44531), 131c311069234c598921039051019fb1 (127.16.219.194:41077)
I20260808 13:48:50.134944 22647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28bad139ad4517b82f963963a6b83c" candidate_uuid: "06a362692a3f4934afd6feb1b036a420" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ba25b4ba0b433a84561b9d0682b045"
I20260808 13:48:50.135389 22647 raft_consensus.cc:3060] T 7e28bad139ad4517b82f963963a6b83c P 47ba25b4ba0b433a84561b9d0682b045 [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:48:50.135324 22726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e28bad139ad4517b82f963963a6b83c" candidate_uuid: "06a362692a3f4934afd6feb1b036a420" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "131c311069234c598921039051019fb1"
I20260808 13:48:50.135948 22726 raft_consensus.cc:3060] T 7e28bad139ad4517b82f963963a6b83c P 131c311069234c598921039051019fb1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 13:48:50.140939 22647 raft_consensus.cc:2468] T 7e28bad139ad4517b82f963963a6b83c P 47ba25b4ba0b433a84561b9d0682b045 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a362692a3f4934afd6feb1b036a420 in term 1.
I20260808 13:48:50.141368 22726 raft_consensus.cc:2468] T 7e28bad139ad4517b82f963963a6b83c P 131c311069234c598921039051019fb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06a362692a3f4934afd6feb1b036a420 in term 1.
I20260808 13:48:50.142112 22767 leader_election.cc:304] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a362692a3f4934afd6feb1b036a420, 47ba25b4ba0b433a84561b9d0682b045; no voters:
I20260808 13:48:50.142799 22946 raft_consensus.cc:2804] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 13:48:50.143687 22946 raft_consensus.cc:697] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 [term 1 LEADER]: Becoming Leader. State: Replica: 06a362692a3f4934afd6feb1b036a420, State: Running, Role: LEADER
I20260808 13:48:50.144528 22946 consensus_queue.cc:237] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a362692a3f4934afd6feb1b036a420" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 45623 } } peers { permanent_uuid: "47ba25b4ba0b433a84561b9d0682b045" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 44531 } } peers { permanent_uuid: "131c311069234c598921039051019fb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41077 } }
I20260808 13:48:50.152139 22532 catalog_manager.cc:5697] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06a362692a3f4934afd6feb1b036a420 (127.16.219.195). New cstate: current_term: 1 leader_uuid: "06a362692a3f4934afd6feb1b036a420" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06a362692a3f4934afd6feb1b036a420" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 45623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47ba25b4ba0b433a84561b9d0682b045" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 44531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "131c311069234c598921039051019fb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41077 } health_report { overall_health: UNKNOWN } } }
I20260808 13:48:50.456858 22796 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260808 13:48:50.460753 22715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 13:48:50.464188 22636 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 13:48:50.473806 22876 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 13:48:50.556283 22946 consensus_queue.cc:1048] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47ba25b4ba0b433a84561b9d0682b045" member_type: VOTER last_known_addr { host: "127.16.219.193" port: 44531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 13:48:50.617472 22946 consensus_queue.cc:1048] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131c311069234c598921039051019fb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260808 13:48:50.744742 22915 heartbeater.cc:499] Master 127.16.219.254:35141 was elected leader, sending a full tablet report...
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
cd7908969be44016b87776d513871c3b | 127.16.219.254:35141 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
06a362692a3f4934afd6feb1b036a420 | 127.16.219.195:45623 | HEALTHY | <none> | 1 | 0
131c311069234c598921039051019fb1 | 127.16.219.194:41077 | HEALTHY | <none> | 0 | 0
47ba25b4ba0b433a84561b9d0682b045 | 127.16.219.193:44531 | HEALTHY | <none> | 0 | 0
bea3f7c0d9af4294affd324f66b23cd4 | 127.16.219.196:39383 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 4
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 4 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
time_source | system_unsync | all 4 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 5 server(s) checked
Tablet Summary
Tablet 7e28bad139ad4517b82f963963a6b83c of table 'test-workload' is conflicted: 2 replicas' active configs disagree with the leader master's
06a362692a3f4934afd6feb1b036a420 (127.16.219.195:45623): RUNNING [LEADER]
47ba25b4ba0b433a84561b9d0682b045 (127.16.219.193:44531): RUNNING
131c311069234c598921039051019fb1 (127.16.219.194:41077): RUNNING
All reported replicas are:
A = 06a362692a3f4934afd6feb1b036a420
B = 47ba25b4ba0b433a84561b9d0682b045
C = 131c311069234c598921039051019fb1
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
master | A* B C | | | Yes
A | A* B C | 1 | -1 | Yes
B | A B C | 1 | -1 | Yes
C | A B C | 1 | -1 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+--------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | CONSENSUS_MISMATCH | 1 | 0 | 0 | 0 | 1
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 0
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Tablet Replica Count Outliers
Type | UUID | Host | Replica Count
-------+----------------------------------+----------------------+---------------
Small | bea3f7c0d9af4294affd324f66b23cd4 | 127.16.219.196:39383 | 0
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 4
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260808 13:48:50.817556 17263 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260808 13:48:51.214733 22796 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260808 13:48:51.223230 22636 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 13:48:51.223487 22715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 13:48:51.228945 22876 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
cd7908969be44016b87776d513871c3b | 127.16.219.254:35141 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
06a362692a3f4934afd6feb1b036a420 | 127.16.219.195:45623 | HEALTHY | <none> | 1 | 0
131c311069234c598921039051019fb1 | 127.16.219.194:41077 | HEALTHY | <none> | 0 | 0
47ba25b4ba0b433a84561b9d0682b045 | 127.16.219.193:44531 | HEALTHY | <none> | 0 | 0
bea3f7c0d9af4294affd324f66b23cd4 | 127.16.219.196:39383 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 4
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 4 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
time_source | system_unsync | all 4 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 5 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
test-workload | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 0
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Tablet Replica Count Outliers
Type | UUID | Host | Replica Count
-------+----------------------------------+----------------------+---------------
Small | bea3f7c0d9af4294affd324f66b23cd4 | 127.16.219.196:39383 | 0
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 4
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260808 13:48:51.475934 17263 log_verifier.cc:126] Checking tablet 7e28bad139ad4517b82f963963a6b83c
I20260808 13:48:51.536049 17263 log_verifier.cc:177] Verified matching terms for 1 ops in tablet 7e28bad139ad4517b82f963963a6b83c
I20260808 13:48:51.538087 17263 tablet_replica.cc:333] T 7e28bad139ad4517b82f963963a6b83c P 47ba25b4ba0b433a84561b9d0682b045: stopping tablet replica
I20260808 13:48:51.538672 17263 raft_consensus.cc:2243] T 7e28bad139ad4517b82f963963a6b83c P 47ba25b4ba0b433a84561b9d0682b045 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 13:48:51.539152 17263 raft_consensus.cc:2272] T 7e28bad139ad4517b82f963963a6b83c P 47ba25b4ba0b433a84561b9d0682b045 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:51.685915 22767 consensus_queue.cc:579] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 [LEADER]: The tablet replica hosted on peer 47ba25b4ba0b433a84561b9d0682b045 has failed
W20260808 13:48:51.686507 22767 consensus_peers.cc:597] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 -> Peer 47ba25b4ba0b433a84561b9d0682b045 (127.16.219.193:44531): Couldn't send request to peer 47ba25b4ba0b433a84561b9d0682b045. Error code: TABLET_FAILED (20). Status: Illegal state: Tablet not RUNNING: FAILED: IO error: INJECTED ERROR: tablet failed. This is attempt 1: this message will repeat every 5th retry.
I20260808 13:48:51.695534 22807 consensus_queue.cc:237] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06a362692a3f4934afd6feb1b036a420" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 45623 } } peers { permanent_uuid: "131c311069234c598921039051019fb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41077 } }
I20260808 13:48:51.700721 22726 raft_consensus.cc:1275] T 7e28bad139ad4517b82f963963a6b83c P 131c311069234c598921039051019fb1 [term 1 FOLLOWER]: Refusing update from remote peer 06a362692a3f4934afd6feb1b036a420: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 13:48:51.702262 23036 consensus_queue.cc:1048] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131c311069234c598921039051019fb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260808 13:48:51.709148 22946 raft_consensus.cc:2955] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 47ba25b4ba0b433a84561b9d0682b045 (127.16.219.193) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06a362692a3f4934afd6feb1b036a420" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 45623 } } peers { permanent_uuid: "131c311069234c598921039051019fb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41077 } } }
I20260808 13:48:51.711483 22726 raft_consensus.cc:2955] T 7e28bad139ad4517b82f963963a6b83c P 131c311069234c598921039051019fb1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 47ba25b4ba0b433a84561b9d0682b045 (127.16.219.193) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06a362692a3f4934afd6feb1b036a420" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 45623 } } peers { permanent_uuid: "131c311069234c598921039051019fb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41077 } } }
I20260808 13:48:51.720619 22519 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7e28bad139ad4517b82f963963a6b83c with cas_config_opid_index -1: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260808 13:48:51.723181 22532 catalog_manager.cc:5697] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 reported cstate change: config changed from index -1 to 2, VOTER 47ba25b4ba0b433a84561b9d0682b045 (127.16.219.193) evicted. New cstate: current_term: 1 leader_uuid: "06a362692a3f4934afd6feb1b036a420" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06a362692a3f4934afd6feb1b036a420" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 45623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "131c311069234c598921039051019fb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41077 } health_report { overall_health: HEALTHY } } }
I20260808 13:48:51.744282 22636 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e28bad139ad4517b82f963963a6b83c with delete_type TABLET_DATA_TOMBSTONED (TS 47ba25b4ba0b433a84561b9d0682b045 not found in new config with opid_index 2) from {username='slave'} at 127.0.0.1:49006
I20260808 13:48:51.745157 22807 consensus_queue.cc:237] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06a362692a3f4934afd6feb1b036a420" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 45623 } } peers { permanent_uuid: "131c311069234c598921039051019fb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41077 } } peers { permanent_uuid: "bea3f7c0d9af4294affd324f66b23cd4" member_type: NON_VOTER last_known_addr { host: "127.16.219.196" port: 39383 } attrs { promote: true } }
I20260808 13:48:51.746537 23057 ts_tablet_manager.cc:1916] T 7e28bad139ad4517b82f963963a6b83c P 47ba25b4ba0b433a84561b9d0682b045: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260808 13:48:51.755565 22726 raft_consensus.cc:1275] T 7e28bad139ad4517b82f963963a6b83c P 131c311069234c598921039051019fb1 [term 1 FOLLOWER]: Refusing update from remote peer 06a362692a3f4934afd6feb1b036a420: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260808 13:48:51.757159 23036 consensus_queue.cc:1048] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131c311069234c598921039051019fb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260808 13:48:51.764506 23036 raft_consensus.cc:2955] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, NON_VOTER bea3f7c0d9af4294affd324f66b23cd4 (127.16.219.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06a362692a3f4934afd6feb1b036a420" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 45623 } } peers { permanent_uuid: "131c311069234c598921039051019fb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41077 } } peers { permanent_uuid: "bea3f7c0d9af4294affd324f66b23cd4" member_type: NON_VOTER last_known_addr { host: "127.16.219.196" port: 39383 } attrs { promote: true } } }
I20260808 13:48:51.771606 23057 ts_tablet_manager.cc:1929] T 7e28bad139ad4517b82f963963a6b83c P 47ba25b4ba0b433a84561b9d0682b045: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260808 13:48:51.771981 23057 log.cc:1199] T 7e28bad139ad4517b82f963963a6b83c P 47ba25b4ba0b433a84561b9d0682b045: Deleting WAL directory at /tmp/dist-test-taskyhJjMq/test-tmp/ts_tablet_manager-itest.0.FailedTabletsAreReplacedITest.OneReplica_1.1786196858807110-17263-0/minicluster-data/ts-0-root/wals/7e28bad139ad4517b82f963963a6b83c
I20260808 13:48:51.773550 22517 catalog_manager.cc:5028] TS 47ba25b4ba0b433a84561b9d0682b045 (127.16.219.193:44531): tablet 7e28bad139ad4517b82f963963a6b83c (table test-workload [id=988ceba10f7b43a6b351f000dc276b45]) successfully deleted
I20260808 13:48:51.776454 22519 catalog_manager.cc:5210] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 7e28bad139ad4517b82f963963a6b83c with cas_config_opid_index 2: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260808 13:48:51.777086 22726 raft_consensus.cc:2955] T 7e28bad139ad4517b82f963963a6b83c P 131c311069234c598921039051019fb1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, NON_VOTER bea3f7c0d9af4294affd324f66b23cd4 (127.16.219.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06a362692a3f4934afd6feb1b036a420" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 45623 } } peers { permanent_uuid: "131c311069234c598921039051019fb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41077 } } peers { permanent_uuid: "bea3f7c0d9af4294affd324f66b23cd4" member_type: NON_VOTER last_known_addr { host: "127.16.219.196" port: 39383 } attrs { promote: true } } }
I20260808 13:48:51.781494 22532 catalog_manager.cc:5697] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 reported cstate change: config changed from index 2 to 3, NON_VOTER bea3f7c0d9af4294affd324f66b23cd4 (127.16.219.196) added. New cstate: current_term: 1 leader_uuid: "06a362692a3f4934afd6feb1b036a420" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06a362692a3f4934afd6feb1b036a420" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 45623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "131c311069234c598921039051019fb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bea3f7c0d9af4294affd324f66b23cd4" member_type: NON_VOTER last_known_addr { host: "127.16.219.196" port: 39383 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260808 13:48:51.784823 22767 consensus_peers.cc:597] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 -> Peer bea3f7c0d9af4294affd324f66b23cd4 (127.16.219.196:39383): Couldn't send request to peer bea3f7c0d9af4294affd324f66b23cd4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7e28bad139ad4517b82f963963a6b83c. This is attempt 1: this message will repeat every 5th retry.
I20260808 13:48:51.823537 22796 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260808 13:48:51.833170 22715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 13:48:51.843161 22636 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 13:48:51.846396 22876 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
cd7908969be44016b87776d513871c3b | 127.16.219.254:35141 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
06a362692a3f4934afd6feb1b036a420 | 127.16.219.195:45623 | HEALTHY | <none> | 1 | 0
131c311069234c598921039051019fb1 | 127.16.219.194:41077 | HEALTHY | <none> | 0 | 0
47ba25b4ba0b433a84561b9d0682b045 | 127.16.219.193:44531 | HEALTHY | <none> | 0 | 0
bea3f7c0d9af4294affd324f66b23cd4 | 127.16.219.196:39383 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 4
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 4 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
time_source | system_unsync | all 4 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 5 server(s) checked
Tablet Summary
Tablet 7e28bad139ad4517b82f963963a6b83c of table 'test-workload' is conflicted: 2 replicas' active configs disagree with the leader master's
06a362692a3f4934afd6feb1b036a420 (127.16.219.195:45623): RUNNING [LEADER]
131c311069234c598921039051019fb1 (127.16.219.194:41077): RUNNING
All reported replicas are:
A = 06a362692a3f4934afd6feb1b036a420
B = 131c311069234c598921039051019fb1
C = bea3f7c0d9af4294affd324f66b23cd4
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
master | A* B | | | Yes
A | A* B C~ | 1 | 3 | Yes
B | A* B C~ | 1 | 3 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+--------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | CONSENSUS_MISMATCH | 1 | 0 | 0 | 0 | 1
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 0
First Quartile | 0
Median | 1
Third Quartile | 1
Maximum | 1
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 4
Tables | 1
Tablets | 1
Replicas | 2
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260808 13:48:52.079636 17263 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260808 13:48:52.209718 23072 ts_tablet_manager.cc:933] T 7e28bad139ad4517b82f963963a6b83c P bea3f7c0d9af4294affd324f66b23cd4: Initiating tablet copy from peer 06a362692a3f4934afd6feb1b036a420 (127.16.219.195:45623)
I20260808 13:48:52.211047 23072 tablet_copy_client.cc:323] T 7e28bad139ad4517b82f963963a6b83c P bea3f7c0d9af4294affd324f66b23cd4: tablet copy: Beginning tablet copy session from remote peer at address 127.16.219.195:45623
I20260808 13:48:52.220526 22817 tablet_copy_service.cc:140] P 06a362692a3f4934afd6feb1b036a420: Received BeginTabletCopySession request for tablet 7e28bad139ad4517b82f963963a6b83c from peer bea3f7c0d9af4294affd324f66b23cd4 ({username='slave'} at 127.0.0.1:34088)
I20260808 13:48:52.220955 22817 tablet_copy_service.cc:161] P 06a362692a3f4934afd6feb1b036a420: Beginning new tablet copy session on tablet 7e28bad139ad4517b82f963963a6b83c from peer bea3f7c0d9af4294affd324f66b23cd4 at {username='slave'} at 127.0.0.1:34088: session id = bea3f7c0d9af4294affd324f66b23cd4-7e28bad139ad4517b82f963963a6b83c
I20260808 13:48:52.226549 22817 tablet_copy_source_session.cc:215] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 13:48:52.229132 23072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e28bad139ad4517b82f963963a6b83c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 13:48:52.241122 23072 tablet_copy_client.cc:806] T 7e28bad139ad4517b82f963963a6b83c P bea3f7c0d9af4294affd324f66b23cd4: tablet copy: Starting download of 0 data blocks...
I20260808 13:48:52.241737 23072 tablet_copy_client.cc:670] T 7e28bad139ad4517b82f963963a6b83c P bea3f7c0d9af4294affd324f66b23cd4: tablet copy: Starting download of 1 WAL segments...
I20260808 13:48:52.245589 23072 tablet_copy_client.cc:538] T 7e28bad139ad4517b82f963963a6b83c P bea3f7c0d9af4294affd324f66b23cd4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 13:48:52.253273 23072 tablet_bootstrap.cc:492] T 7e28bad139ad4517b82f963963a6b83c P bea3f7c0d9af4294affd324f66b23cd4: Bootstrap starting.
I20260808 13:48:52.271394 23072 tablet_bootstrap.cc:492] T 7e28bad139ad4517b82f963963a6b83c P bea3f7c0d9af4294affd324f66b23cd4: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 13:48:52.272128 23072 tablet_bootstrap.cc:492] T 7e28bad139ad4517b82f963963a6b83c P bea3f7c0d9af4294affd324f66b23cd4: Bootstrap complete.
I20260808 13:48:52.272686 23072 ts_tablet_manager.cc:1403] T 7e28bad139ad4517b82f963963a6b83c P bea3f7c0d9af4294affd324f66b23cd4: Time spent bootstrapping tablet: real 0.020s user 0.018s sys 0.001s
I20260808 13:48:52.274958 23072 raft_consensus.cc:359] T 7e28bad139ad4517b82f963963a6b83c P bea3f7c0d9af4294affd324f66b23cd4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06a362692a3f4934afd6feb1b036a420" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 45623 } } peers { permanent_uuid: "131c311069234c598921039051019fb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41077 } } peers { permanent_uuid: "bea3f7c0d9af4294affd324f66b23cd4" member_type: NON_VOTER last_known_addr { host: "127.16.219.196" port: 39383 } attrs { promote: true } }
I20260808 13:48:52.275516 23072 raft_consensus.cc:740] T 7e28bad139ad4517b82f963963a6b83c P bea3f7c0d9af4294affd324f66b23cd4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bea3f7c0d9af4294affd324f66b23cd4, State: Initialized, Role: LEARNER
I20260808 13:48:52.276042 23072 consensus_queue.cc:260] T 7e28bad139ad4517b82f963963a6b83c P bea3f7c0d9af4294affd324f66b23cd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06a362692a3f4934afd6feb1b036a420" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 45623 } } peers { permanent_uuid: "131c311069234c598921039051019fb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41077 } } peers { permanent_uuid: "bea3f7c0d9af4294affd324f66b23cd4" member_type: NON_VOTER last_known_addr { host: "127.16.219.196" port: 39383 } attrs { promote: true } }
I20260808 13:48:52.278578 23072 ts_tablet_manager.cc:1434] T 7e28bad139ad4517b82f963963a6b83c P bea3f7c0d9af4294affd324f66b23cd4: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260808 13:48:52.280248 22817 tablet_copy_service.cc:342] P 06a362692a3f4934afd6feb1b036a420: Request end of tablet copy session bea3f7c0d9af4294affd324f66b23cd4-7e28bad139ad4517b82f963963a6b83c received from {username='slave'} at 127.0.0.1:34088
I20260808 13:48:52.280599 22817 tablet_copy_service.cc:434] P 06a362692a3f4934afd6feb1b036a420: ending tablet copy session bea3f7c0d9af4294affd324f66b23cd4-7e28bad139ad4517b82f963963a6b83c on tablet 7e28bad139ad4517b82f963963a6b83c with peer bea3f7c0d9af4294affd324f66b23cd4
I20260808 13:48:52.466702 22796 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260808 13:48:52.481938 22715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 13:48:52.484283 22876 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 13:48:52.485054 22636 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
cd7908969be44016b87776d513871c3b | 127.16.219.254:35141 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
06a362692a3f4934afd6feb1b036a420 | 127.16.219.195:45623 | HEALTHY | <none> | 1 | 0
131c311069234c598921039051019fb1 | 127.16.219.194:41077 | HEALTHY | <none> | 0 | 0
47ba25b4ba0b433a84561b9d0682b045 | 127.16.219.193:44531 | HEALTHY | <none> | 0 | 0
bea3f7c0d9af4294affd324f66b23cd4 | 127.16.219.196:39383 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 4
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 4 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
time_source | system_unsync | all 4 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 5 server(s) checked
Tablet Summary
Tablet 7e28bad139ad4517b82f963963a6b83c of table 'test-workload' is conflicted: 1 replicas' active configs disagree with the leader master's
06a362692a3f4934afd6feb1b036a420 (127.16.219.195:45623): RUNNING [LEADER]
131c311069234c598921039051019fb1 (127.16.219.194:41077): RUNNING
bea3f7c0d9af4294affd324f66b23cd4 (127.16.219.196:39383): RUNNING [NONVOTER]
All reported replicas are:
A = 06a362692a3f4934afd6feb1b036a420
B = 131c311069234c598921039051019fb1
C = bea3f7c0d9af4294affd324f66b23cd4
The consensus matrix is:
Config source | Replicas | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
master | A* B C~ | | | Yes
A | A* B C~ | 1 | 3 | Yes
B | A* B C~ | 1 | 3 | Yes
C | A B C~ | 1 | 3 | Yes
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+--------------------+---------------+---------+------------+------------------+-------------
test-workload | 3 | CONSENSUS_MISMATCH | 1 | 0 | 0 | 0 | 1
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 0
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Tablet Replica Count Outliers
Type | UUID | Host | Replica Count
-------+----------------------------------+----------------------+---------------
Small | 47ba25b4ba0b433a84561b9d0682b045 | 127.16.219.193:44531 | 0
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 4
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy
FAILED
I20260808 13:48:52.756292 17263 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260808 13:48:52.773154 22887 raft_consensus.cc:1217] T 7e28bad139ad4517b82f963963a6b83c P bea3f7c0d9af4294affd324f66b23cd4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.2->[1.3-1.3] Dedup: 1.3->[]
I20260808 13:48:53.215438 22715 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 13:48:53.215441 22796 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260808 13:48:53.226547 22636 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 13:48:53.231276 22876 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260808 13:48:53.381937 23107 raft_consensus.cc:1064] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420: attempting to promote NON_VOTER bea3f7c0d9af4294affd324f66b23cd4 to VOTER
I20260808 13:48:53.384320 23107 consensus_queue.cc:237] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06a362692a3f4934afd6feb1b036a420" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 45623 } } peers { permanent_uuid: "131c311069234c598921039051019fb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41077 } } peers { permanent_uuid: "bea3f7c0d9af4294affd324f66b23cd4" member_type: VOTER last_known_addr { host: "127.16.219.196" port: 39383 } attrs { promote: false } }
I20260808 13:48:53.402024 22887 raft_consensus.cc:1275] T 7e28bad139ad4517b82f963963a6b83c P bea3f7c0d9af4294affd324f66b23cd4 [term 1 LEARNER]: Refusing update from remote peer 06a362692a3f4934afd6feb1b036a420: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260808 13:48:53.403671 22726 raft_consensus.cc:1275] T 7e28bad139ad4517b82f963963a6b83c P 131c311069234c598921039051019fb1 [term 1 FOLLOWER]: Refusing update from remote peer 06a362692a3f4934afd6feb1b036a420: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260808 13:48:53.406409 23138 consensus_queue.cc:1048] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 [LEADER]: Connected to new peer: Peer: permanent_uuid: "131c311069234c598921039051019fb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260808 13:48:53.408159 23138 consensus_queue.cc:1048] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bea3f7c0d9af4294affd324f66b23cd4" member_type: VOTER last_known_addr { host: "127.16.219.196" port: 39383 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260808 13:48:53.426010 23138 raft_consensus.cc:2955] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, bea3f7c0d9af4294affd324f66b23cd4 (127.16.219.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06a362692a3f4934afd6feb1b036a420" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 45623 } } peers { permanent_uuid: "131c311069234c598921039051019fb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41077 } } peers { permanent_uuid: "bea3f7c0d9af4294affd324f66b23cd4" member_type: VOTER last_known_addr { host: "127.16.219.196" port: 39383 } attrs { promote: false } } }
I20260808 13:48:53.438391 22726 raft_consensus.cc:2955] T 7e28bad139ad4517b82f963963a6b83c P 131c311069234c598921039051019fb1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, bea3f7c0d9af4294affd324f66b23cd4 (127.16.219.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06a362692a3f4934afd6feb1b036a420" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 45623 } } peers { permanent_uuid: "131c311069234c598921039051019fb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41077 } } peers { permanent_uuid: "bea3f7c0d9af4294affd324f66b23cd4" member_type: VOTER last_known_addr { host: "127.16.219.196" port: 39383 } attrs { promote: false } } }
I20260808 13:48:53.444553 22887 raft_consensus.cc:2955] T 7e28bad139ad4517b82f963963a6b83c P bea3f7c0d9af4294affd324f66b23cd4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, bea3f7c0d9af4294affd324f66b23cd4 (127.16.219.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06a362692a3f4934afd6feb1b036a420" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 45623 } } peers { permanent_uuid: "131c311069234c598921039051019fb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41077 } } peers { permanent_uuid: "bea3f7c0d9af4294affd324f66b23cd4" member_type: VOTER last_known_addr { host: "127.16.219.196" port: 39383 } attrs { promote: false } } }
I20260808 13:48:53.463932 22532 catalog_manager.cc:5697] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 reported cstate change: config changed from index 3 to 4, bea3f7c0d9af4294affd324f66b23cd4 (127.16.219.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "06a362692a3f4934afd6feb1b036a420" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06a362692a3f4934afd6feb1b036a420" member_type: VOTER last_known_addr { host: "127.16.219.195" port: 45623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "131c311069234c598921039051019fb1" member_type: VOTER last_known_addr { host: "127.16.219.194" port: 41077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bea3f7c0d9af4294affd324f66b23cd4" member_type: VOTER last_known_addr { host: "127.16.219.196" port: 39383 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
cd7908969be44016b87776d513871c3b | 127.16.219.254:35141 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 1 server(s) checked
time_source | system_unsync | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
06a362692a3f4934afd6feb1b036a420 | 127.16.219.195:45623 | HEALTHY | <none> | 1 | 0
131c311069234c598921039051019fb1 | 127.16.219.194:41077 | HEALTHY | <none> | 0 | 0
47ba25b4ba0b433a84561b9d0682b045 | 127.16.219.193:44531 | HEALTHY | <none> | 0 | 0
bea3f7c0d9af4294affd324f66b23cd4 | 127.16.219.196:39383 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 4
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
----------------------------------+-------+--------+-------------------------
rpc_server_allow_ephemeral_ports | true | unsafe | all 4 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+-------------------------------------------------------------+-------------------------
builtin_ntp_servers | 0.pool.ntp.org,1.pool.ntp.org,2.pool.ntp.org,3.pool.ntp.org | all 4 server(s) checked
time_source | system_unsync | all 4 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.19.0-SNAPSHOT | all 5 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
test-workload | 3 | HEALTHY | 1 | 1 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 0
First Quartile | 1
Median | 1
Third Quartile | 1
Maximum | 1
Tablet Replica Count Outliers
Type | UUID | Host | Replica Count
-------+----------------------------------+----------------------+---------------
Small | 47ba25b4ba0b433a84561b9d0682b045 | 127.16.219.193:44531 | 0
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 4
Tables | 1
Tablets | 1
Replicas | 3
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260808 13:48:53.521816 17263 log_verifier.cc:126] Checking tablet 7e28bad139ad4517b82f963963a6b83c
I20260808 13:48:53.580612 17263 log_verifier.cc:177] Verified matching terms for 4 ops in tablet 7e28bad139ad4517b82f963963a6b83c
I20260808 13:48:53.583118 17263 tablet_server.cc:179] TabletServer@127.16.219.193:0 shutting down...
I20260808 13:48:53.609344 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 13:48:53.627682 17263 tablet_server.cc:196] TabletServer@127.16.219.193:0 shutdown complete.
I20260808 13:48:53.639189 17263 tablet_server.cc:179] TabletServer@127.16.219.194:0 shutting down...
I20260808 13:48:53.661976 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 13:48:53.662734 17263 tablet_replica.cc:333] T 7e28bad139ad4517b82f963963a6b83c P 131c311069234c598921039051019fb1: stopping tablet replica
I20260808 13:48:53.663290 17263 raft_consensus.cc:2243] T 7e28bad139ad4517b82f963963a6b83c P 131c311069234c598921039051019fb1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 13:48:53.663879 17263 raft_consensus.cc:2272] T 7e28bad139ad4517b82f963963a6b83c P 131c311069234c598921039051019fb1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:53.684778 17263 tablet_server.cc:196] TabletServer@127.16.219.194:0 shutdown complete.
I20260808 13:48:53.694804 17263 tablet_server.cc:179] TabletServer@127.16.219.195:0 shutting down...
I20260808 13:48:53.715795 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 13:48:53.716404 17263 tablet_replica.cc:333] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420: stopping tablet replica
I20260808 13:48:53.716926 17263 raft_consensus.cc:2243] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 [term 1 LEADER]: Raft consensus shutting down.
I20260808 13:48:53.717767 17263 raft_consensus.cc:2272] T 7e28bad139ad4517b82f963963a6b83c P 06a362692a3f4934afd6feb1b036a420 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:53.738586 17263 tablet_server.cc:196] TabletServer@127.16.219.195:0 shutdown complete.
I20260808 13:48:53.748297 17263 tablet_server.cc:179] TabletServer@127.16.219.196:0 shutting down...
I20260808 13:48:53.769341 17263 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260808 13:48:53.769891 17263 tablet_replica.cc:333] T 7e28bad139ad4517b82f963963a6b83c P bea3f7c0d9af4294affd324f66b23cd4: stopping tablet replica
I20260808 13:48:53.770426 17263 raft_consensus.cc:2243] T 7e28bad139ad4517b82f963963a6b83c P bea3f7c0d9af4294affd324f66b23cd4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 13:48:53.770889 17263 raft_consensus.cc:2272] T 7e28bad139ad4517b82f963963a6b83c P bea3f7c0d9af4294affd324f66b23cd4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:53.790405 17263 tablet_server.cc:196] TabletServer@127.16.219.196:0 shutdown complete.
I20260808 13:48:53.800020 17263 master.cc:562] Master@127.16.219.254:35141 shutting down...
I20260808 13:48:53.819113 17263 raft_consensus.cc:2243] T 00000000000000000000000000000000 P cd7908969be44016b87776d513871c3b [term 1 LEADER]: Raft consensus shutting down.
I20260808 13:48:53.819681 17263 raft_consensus.cc:2272] T 00000000000000000000000000000000 P cd7908969be44016b87776d513871c3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 13:48:53.820025 17263 tablet_replica.cc:333] T 00000000000000000000000000000000 P cd7908969be44016b87776d513871c3b: stopping tablet replica
I20260808 13:48:53.839197 17263 master.cc:584] Master@127.16.219.254:35141 shutdown complete.
[ OK ] FailedTabletsAreReplacedITest.OneReplica/1 (4813 ms)
[----------] 2 tests from FailedTabletsAreReplacedITest (14773 ms total)
[----------] Global test environment tear-down
[==========] 13 tests from 4 test suites ran. (74851 ms total)
[ PASSED ] 11 tests.
[ SKIPPED ] 1 test, listed below:
[ SKIPPED ] LeadershipChangeReportingTest.TestReportStatsDuringLeadershipChange
[ FAILED ] 1 test, listed below:
[ FAILED ] TsTabletManagerITest.TestTableStats
1 FAILED TEST
I20260808 13:48:53.879887 17263 logging.cc:436] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/client/meta_cache.cc:788: suppressed but not reported on 3 messages since previous log ~15 seconds ago
I20260808 13:48:53.880231 17263 logging.cc:436] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 114 messages since previous log ~64 seconds ago
I20260808 13:48:53.880448 17263 logging.cc:436] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 17 messages since previous log ~20 seconds ago
I20260808 13:48:53.880744 17263 logging.cc:436] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 8 messages since previous log ~19 seconds ago