[==========] Running 4 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 4 tests from TimestampAdvancementITest
[ RUN ] TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260204 09:11:01.869110 10112 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.224.62:37085
I20260204 09:11:01.869539 10112 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260204 09:11:01.869696 10112 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 09:11:01.873766 10117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 09:11:01.873843 10112 server_base.cc:1060] running on GCE node
W20260204 09:11:01.873992 10118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 09:11:01.874167 10120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 09:11:01.874399 10112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 09:11:01.874461 10112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 09:11:01.874488 10112 hybrid_clock.cc:648] HybridClock initialized: now 1770196261874489 us; error 0 us; skew 500 ppm
I20260204 09:11:01.875560 10112 webserver.cc:492] Webserver started at http://127.9.224.62:41089/ using document root <none> and password file <none>
I20260204 09:11:01.875705 10112 fs_manager.cc:362] Metadata directory not provided
I20260204 09:11:01.875751 10112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 09:11:01.875826 10112 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 09:11:01.876794 10112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1770196261863819-10112-0/minicluster-data/master-0-root/instance:
uuid: "3adb304102e74e299fa193e13058a041"
format_stamp: "Formatted at 2026-02-04 09:11:01 on dist-test-slave-4hq3"
I20260204 09:11:01.877892 10112 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260204 09:11:01.878357 10125 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:01.878494 10112 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:01.878552 10112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1770196261863819-10112-0/minicluster-data/master-0-root
uuid: "3adb304102e74e299fa193e13058a041"
format_stamp: "Formatted at 2026-02-04 09:11:01 on dist-test-slave-4hq3"
I20260204 09:11:01.878607 10112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1770196261863819-10112-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1770196261863819-10112-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1770196261863819-10112-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 09:11:01.893281 10112 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 09:11:01.893568 10112 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260204 09:11:01.893667 10112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 09:11:01.893961 10131 maintenance_manager.cc:346] Maintenance manager is disabled (check --enable_maintenance_manager).
I20260204 09:11:01.897528 10112 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.62:37085
I20260204 09:11:01.897567 10177 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.224.62:37085 every 8 connection(s)
I20260204 09:11:01.898105 10178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 09:11:01.900389 10178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3adb304102e74e299fa193e13058a041: Bootstrap starting.
I20260204 09:11:01.901149 10178 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3adb304102e74e299fa193e13058a041: Neither blocks nor log segments found. Creating new log.
I20260204 09:11:01.901350 10178 log.cc:826] T 00000000000000000000000000000000 P 3adb304102e74e299fa193e13058a041: Log is configured to *not* fsync() on all Append() calls
I20260204 09:11:01.901867 10178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3adb304102e74e299fa193e13058a041: No bootstrap required, opened a new log
I20260204 09:11:01.902985 10178 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3adb304102e74e299fa193e13058a041 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3adb304102e74e299fa193e13058a041" member_type: VOTER }
I20260204 09:11:01.903075 10178 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3adb304102e74e299fa193e13058a041 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 09:11:01.903093 10178 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3adb304102e74e299fa193e13058a041 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3adb304102e74e299fa193e13058a041, State: Initialized, Role: FOLLOWER
I20260204 09:11:01.903199 10178 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3adb304102e74e299fa193e13058a041 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3adb304102e74e299fa193e13058a041" member_type: VOTER }
I20260204 09:11:01.903250 10178 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3adb304102e74e299fa193e13058a041 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260204 09:11:01.903270 10178 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3adb304102e74e299fa193e13058a041 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260204 09:11:01.903311 10178 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3adb304102e74e299fa193e13058a041 [term 0 FOLLOWER]: Advancing to term 1
I20260204 09:11:01.903775 10178 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3adb304102e74e299fa193e13058a041 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3adb304102e74e299fa193e13058a041" member_type: VOTER }
I20260204 09:11:01.903868 10178 leader_election.cc:304] T 00000000000000000000000000000000 P 3adb304102e74e299fa193e13058a041 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3adb304102e74e299fa193e13058a041; no voters:
I20260204 09:11:01.904007 10178 leader_election.cc:290] T 00000000000000000000000000000000 P 3adb304102e74e299fa193e13058a041 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260204 09:11:01.904049 10181 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3adb304102e74e299fa193e13058a041 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 09:11:01.904165 10181 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3adb304102e74e299fa193e13058a041 [term 1 LEADER]: Becoming Leader. State: Replica: 3adb304102e74e299fa193e13058a041, State: Running, Role: LEADER
I20260204 09:11:01.904217 10178 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3adb304102e74e299fa193e13058a041 [sys.catalog]: configured and running, proceeding with master startup.
I20260204 09:11:01.904276 10181 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3adb304102e74e299fa193e13058a041 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3adb304102e74e299fa193e13058a041" member_type: VOTER }
I20260204 09:11:01.904616 10182 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3adb304102e74e299fa193e13058a041 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3adb304102e74e299fa193e13058a041" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3adb304102e74e299fa193e13058a041" member_type: VOTER } }
I20260204 09:11:01.904645 10183 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3adb304102e74e299fa193e13058a041 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3adb304102e74e299fa193e13058a041. Latest consensus state: current_term: 1 leader_uuid: "3adb304102e74e299fa193e13058a041" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3adb304102e74e299fa193e13058a041" member_type: VOTER } }
I20260204 09:11:01.904757 10182 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3adb304102e74e299fa193e13058a041 [sys.catalog]: This master's current role is: LEADER
I20260204 09:11:01.904927 10183 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3adb304102e74e299fa193e13058a041 [sys.catalog]: This master's current role is: LEADER
I20260204 09:11:01.905082 10190 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260204 09:11:01.905521 10190 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260204 09:11:01.905666 10112 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260204 09:11:01.906790 10190 catalog_manager.cc:1357] Generated new cluster ID: 8c3f59e78a3849d697b3dfd7dd668b6b
I20260204 09:11:01.906840 10190 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260204 09:11:01.913761 10190 catalog_manager.cc:1380] Generated new certificate authority record
I20260204 09:11:01.914247 10190 catalog_manager.cc:1514] Loading token signing keys...
I20260204 09:11:01.921847 10190 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 3adb304102e74e299fa193e13058a041: Generated new TSK 0
I20260204 09:11:01.921984 10190 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260204 09:11:01.937505 10112 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 09:11:01.938773 10200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 09:11:01.938772 10203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 09:11:01.938967 10201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 09:11:01.939054 10112 server_base.cc:1060] running on GCE node
I20260204 09:11:01.939141 10112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 09:11:01.939173 10112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 09:11:01.939190 10112 hybrid_clock.cc:648] HybridClock initialized: now 1770196261939190 us; error 0 us; skew 500 ppm
I20260204 09:11:01.939749 10112 webserver.cc:492] Webserver started at http://127.9.224.1:38057/ using document root <none> and password file <none>
I20260204 09:11:01.939832 10112 fs_manager.cc:362] Metadata directory not provided
I20260204 09:11:01.939877 10112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 09:11:01.939924 10112 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 09:11:01.940167 10112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1770196261863819-10112-0/minicluster-data/ts-0-root/instance:
uuid: "11502cf05241427fb9853e628add7746"
format_stamp: "Formatted at 2026-02-04 09:11:01 on dist-test-slave-4hq3"
I20260204 09:11:01.940938 10112 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260204 09:11:01.941408 10208 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:01.941531 10112 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:01.941588 10112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1770196261863819-10112-0/minicluster-data/ts-0-root
uuid: "11502cf05241427fb9853e628add7746"
format_stamp: "Formatted at 2026-02-04 09:11:01 on dist-test-slave-4hq3"
I20260204 09:11:01.941634 10112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1770196261863819-10112-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1770196261863819-10112-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1770196261863819-10112-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 09:11:01.951812 10112 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 09:11:01.952077 10112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 09:11:01.952279 10112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260204 09:11:01.952593 10112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260204 09:11:01.952636 10112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:01.952673 10112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260204 09:11:01.952701 10112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:01.957015 10112 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.1:45383
I20260204 09:11:01.957041 10271 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.224.1:45383 every 8 connection(s)
I20260204 09:11:01.957412 10112 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 09:11:01.958669 10279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 09:11:01.958724 10276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 09:11:01.958904 10112 server_base.cc:1060] running on GCE node
W20260204 09:11:01.959777 10275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 09:11:01.959997 10112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 09:11:01.960044 10112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 09:11:01.960062 10112 hybrid_clock.cc:648] HybridClock initialized: now 1770196261960062 us; error 0 us; skew 500 ppm
I20260204 09:11:01.960668 10112 webserver.cc:492] Webserver started at http://127.9.224.2:34077/ using document root <none> and password file <none>
I20260204 09:11:01.960757 10112 fs_manager.cc:362] Metadata directory not provided
I20260204 09:11:01.960806 10112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 09:11:01.960852 10112 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 09:11:01.961094 10112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1770196261863819-10112-0/minicluster-data/ts-1-root/instance:
uuid: "bd38b0e96f264071a69be73b6b4f14c1"
format_stamp: "Formatted at 2026-02-04 09:11:01 on dist-test-slave-4hq3"
I20260204 09:11:01.961840 10272 heartbeater.cc:344] Connected to a master server at 127.9.224.62:37085
I20260204 09:11:01.961921 10272 heartbeater.cc:461] Registering TS with master...
I20260204 09:11:01.962018 10112 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260204 09:11:01.962095 10272 heartbeater.cc:507] Master 127.9.224.62:37085 requested a full tablet report, sending...
I20260204 09:11:01.962491 10284 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:01.962558 10142 ts_manager.cc:194] Registered new tserver with Master: 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:01.962589 10112 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:01.962623 10112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1770196261863819-10112-0/minicluster-data/ts-1-root
uuid: "bd38b0e96f264071a69be73b6b4f14c1"
format_stamp: "Formatted at 2026-02-04 09:11:01 on dist-test-slave-4hq3"
I20260204 09:11:01.962666 10112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1770196261863819-10112-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1770196261863819-10112-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1770196261863819-10112-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 09:11:01.963483 10142 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58400
I20260204 09:11:01.973057 10112 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 09:11:01.973289 10112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 09:11:01.973464 10112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260204 09:11:01.973649 10112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260204 09:11:01.973690 10112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:01.973718 10112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260204 09:11:01.973742 10112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:01.977025 10112 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.2:43259
I20260204 09:11:01.977097 10347 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.224.2:43259 every 8 connection(s)
I20260204 09:11:01.977425 10112 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 09:11:01.978428 10351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 09:11:01.979025 10352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 09:11:01.979079 10354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 09:11:01.979208 10112 server_base.cc:1060] running on GCE node
I20260204 09:11:01.979390 10112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 09:11:01.979424 10112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 09:11:01.979441 10112 hybrid_clock.cc:648] HybridClock initialized: now 1770196261979441 us; error 0 us; skew 500 ppm
I20260204 09:11:01.980024 10112 webserver.cc:492] Webserver started at http://127.9.224.3:44837/ using document root <none> and password file <none>
I20260204 09:11:01.980114 10112 fs_manager.cc:362] Metadata directory not provided
I20260204 09:11:01.980159 10112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 09:11:01.980211 10112 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 09:11:01.980504 10112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1770196261863819-10112-0/minicluster-data/ts-2-root/instance:
uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
format_stamp: "Formatted at 2026-02-04 09:11:01 on dist-test-slave-4hq3"
I20260204 09:11:01.980749 10348 heartbeater.cc:344] Connected to a master server at 127.9.224.62:37085
I20260204 09:11:01.980803 10348 heartbeater.cc:461] Registering TS with master...
I20260204 09:11:01.980906 10348 heartbeater.cc:507] Master 127.9.224.62:37085 requested a full tablet report, sending...
I20260204 09:11:01.981145 10142 ts_manager.cc:194] Registered new tserver with Master: bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:01.981583 10142 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58402
I20260204 09:11:01.985532 10112 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.000s sys 0.001s
I20260204 09:11:01.985983 10359 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:01.986158 10112 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:01.986200 10112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1770196261863819-10112-0/minicluster-data/ts-2-root
uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
format_stamp: "Formatted at 2026-02-04 09:11:01 on dist-test-slave-4hq3"
I20260204 09:11:01.986248 10112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1770196261863819-10112-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1770196261863819-10112-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1770196261863819-10112-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 09:11:02.011169 10112 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 09:11:02.011421 10112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 09:11:02.011571 10112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260204 09:11:02.011773 10112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260204 09:11:02.011801 10112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:02.011829 10112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260204 09:11:02.011852 10112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:02.015286 10112 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.3:33317
I20260204 09:11:02.015385 10422 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.224.3:33317 every 8 connection(s)
I20260204 09:11:02.018954 10423 heartbeater.cc:344] Connected to a master server at 127.9.224.62:37085
I20260204 09:11:02.019027 10423 heartbeater.cc:461] Registering TS with master...
I20260204 09:11:02.019129 10423 heartbeater.cc:507] Master 127.9.224.62:37085 requested a full tablet report, sending...
I20260204 09:11:02.019337 10142 ts_manager.cc:194] Registered new tserver with Master: 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317)
I20260204 09:11:02.019675 10142 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58418
I20260204 09:11:02.019892 10112 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.004419602s
I20260204 09:11:02.034309 10142 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58448:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260204 09:11:02.034600 10142 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260204 09:11:02.040346 10387 tablet_service.cc:1505] Processing CreateTablet for tablet 75502959dace4d33aa1d322299eefe57 (DEFAULT_TABLE table=test-workload [id=f8c1f2ea858d400282d141abafaca0ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260204 09:11:02.040467 10312 tablet_service.cc:1505] Processing CreateTablet for tablet 75502959dace4d33aa1d322299eefe57 (DEFAULT_TABLE table=test-workload [id=f8c1f2ea858d400282d141abafaca0ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260204 09:11:02.040537 10312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75502959dace4d33aa1d322299eefe57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 09:11:02.041009 10236 tablet_service.cc:1505] Processing CreateTablet for tablet 75502959dace4d33aa1d322299eefe57 (DEFAULT_TABLE table=test-workload [id=f8c1f2ea858d400282d141abafaca0ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260204 09:11:02.041134 10236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75502959dace4d33aa1d322299eefe57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 09:11:02.040539 10387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75502959dace4d33aa1d322299eefe57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 09:11:02.042533 10444 tablet_bootstrap.cc:492] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2: Bootstrap starting.
I20260204 09:11:02.043061 10444 tablet_bootstrap.cc:654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2: Neither blocks nor log segments found. Creating new log.
I20260204 09:11:02.043473 10446 tablet_bootstrap.cc:492] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Bootstrap starting.
I20260204 09:11:02.044072 10446 tablet_bootstrap.cc:654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Neither blocks nor log segments found. Creating new log.
I20260204 09:11:02.044723 10446 tablet_bootstrap.cc:492] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: No bootstrap required, opened a new log
I20260204 09:11:02.044772 10446 ts_tablet_manager.cc:1403] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260204 09:11:02.044972 10446 raft_consensus.cc:359] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:02.045050 10446 raft_consensus.cc:385] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 09:11:02.045078 10446 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Initialized, Role: FOLLOWER
I20260204 09:11:02.045120 10446 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:02.045295 10446 ts_tablet_manager.cc:1434] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260204 09:11:02.045341 10348 heartbeater.cc:499] Master 127.9.224.62:37085 was elected leader, sending a full tablet report...
I20260204 09:11:02.049458 10445 tablet_bootstrap.cc:492] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Bootstrap starting.
I20260204 09:11:02.049899 10444 tablet_bootstrap.cc:492] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2: No bootstrap required, opened a new log
I20260204 09:11:02.049899 10445 tablet_bootstrap.cc:654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Neither blocks nor log segments found. Creating new log.
I20260204 09:11:02.049978 10444 ts_tablet_manager.cc:1403] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20260204 09:11:02.050137 10444 raft_consensus.cc:359] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:02.050208 10444 raft_consensus.cc:385] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 09:11:02.050227 10444 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Initialized, Role: FOLLOWER
I20260204 09:11:02.050271 10444 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:02.050422 10444 ts_tablet_manager.cc:1434] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260204 09:11:02.050493 10423 heartbeater.cc:499] Master 127.9.224.62:37085 was elected leader, sending a full tablet report...
I20260204 09:11:02.050596 10445 tablet_bootstrap.cc:492] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: No bootstrap required, opened a new log
I20260204 09:11:02.050642 10445 ts_tablet_manager.cc:1403] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260204 09:11:02.050792 10445 raft_consensus.cc:359] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:02.050848 10445 raft_consensus.cc:385] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 09:11:02.050889 10445 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Initialized, Role: FOLLOWER
I20260204 09:11:02.050949 10445 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:02.051112 10445 ts_tablet_manager.cc:1434] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260204 09:11:02.051152 10272 heartbeater.cc:499] Master 127.9.224.62:37085 was elected leader, sending a full tablet report...
I20260204 09:11:02.088371 10449 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:11:02.088469 10449 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:02.088721 10449 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:02.091898 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" is_pre_election: true
I20260204 09:11:02.091898 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746" is_pre_election: true
I20260204 09:11:02.092036 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 0.
I20260204 09:11:02.092036 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 0.
I20260204 09:11:02.092212 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters:
I20260204 09:11:02.092299 10449 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 09:11:02.092334 10449 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:02.092348 10449 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 0 FOLLOWER]: Advancing to term 1
I20260204 09:11:02.092927 10449 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:02.093034 10449 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 1 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:02.093183 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:02.093194 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:02.093263 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 0 FOLLOWER]: Advancing to term 1
I20260204 09:11:02.093266 10246 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 0 FOLLOWER]: Advancing to term 1
I20260204 09:11:02.093993 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 1.
I20260204 09:11:02.094008 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 1.
I20260204 09:11:02.094147 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters:
I20260204 09:11:02.094233 10449 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 09:11:02.094369 10449 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 1 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:02.094416 10449 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:02.094996 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 1 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:02.113680 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 1 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260204 09:11:02.113680 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 1 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 09:11:02.114027 10462 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 09:11:02.114130 10449 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 09:11:02.131975 10112 test_workload.cc:405] TestWorkload: Skipping table creation because table test-workload already exists
I20260204 09:11:02.340905 10451 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:02.340997 10451 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 1 FOLLOWER]: Advancing to term 2
I20260204 09:11:02.341715 10451 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:02.341910 10451 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 2 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:02.344233 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 39 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:02.344199 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 39 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:02.344470 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:02.344566 10451 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260204 09:11:02.349654 10452 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:02.349696 10452 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 1 FOLLOWER]: Advancing to term 2
I20260204 09:11:02.350309 10452 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:02.350471 10452 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 2 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:02.352770 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 2 candidate_status { last_received { term: 1 index: 39 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:02.352851 10397 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 11502cf05241427fb9853e628add7746 in current term 2: Already voted for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in this term.
I20260204 09:11:02.352905 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 2 candidate_status { last_received { term: 1 index: 39 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:02.353080 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11502cf05241427fb9853e628add7746; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:02.353163 10452 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260204 09:11:02.353675 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 2 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 1. Current term is 2. Ops: []
I20260204 09:11:02.353843 10489 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 1.39, Next index: 40, Last known committed idx: 39, Time since last communication: 0.000s
W20260204 09:11:02.353950 10489 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20260204 09:11:02.353981 10489 fault_injection.cc:44] THIS SERVER MAY CRASH!
I20260204 09:11:02.370081 10489 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260204 09:11:02.370137 10489 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:02.370193 10489 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 39, Committed index: 39, Last appended: 1.39, Last appended by leader: 39, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:02.370297 10489 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 1 FOLLOWER]: Advancing to term 2
I20260204 09:11:02.467451 10452 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:02.467538 10452 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 2 FOLLOWER]: Advancing to term 3
I20260204 09:11:02.468176 10452 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:02.468336 10452 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 3 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:02.468536 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 3 candidate_status { last_received { term: 1 index: 39 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:02.468533 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 3 candidate_status { last_received { term: 1 index: 39 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:02.468633 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 2 FOLLOWER]: Advancing to term 3
I20260204 09:11:02.468658 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 2 FOLLOWER]: Advancing to term 3
I20260204 09:11:02.469183 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 3.
I20260204 09:11:02.469228 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 3.
I20260204 09:11:02.469370 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters:
I20260204 09:11:02.469475 10452 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 3 FOLLOWER]: Leader election won for term 3
I20260204 09:11:02.469585 10452 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 3 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:02.469636 10452 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 39, Committed index: 39, Last appended: 1.39, Last appended by leader: 39, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:02.470044 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 1 to 3, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 3 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:02.563504 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 3 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 1 index: 39. Preceding OpId from leader: term: 3 index: 40. (index mismatch)
I20260204 09:11:02.563751 10452 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 40, Last known committed idx: 39, Time since last communication: 0.000s
I20260204 09:11:02.579488 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 3 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 1 index: 39. Preceding OpId from leader: term: 3 index: 40. (index mismatch)
I20260204 09:11:02.579731 10452 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 40, Last known committed idx: 39, Time since last communication: 0.000s
I20260204 09:11:02.664744 10489 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:02.664836 10489 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 3 FOLLOWER]: Advancing to term 4
I20260204 09:11:02.665498 10489 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:02.665630 10489 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 4 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:02.665771 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 40 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:02.665792 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 40 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:02.666013 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:02.666105 10489 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260204 09:11:02.675297 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 4 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 3. Current term is 4. Ops: []
I20260204 09:11:02.675501 10492 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 3.40, Next index: 41, Last known committed idx: 40, Time since last communication: 0.000s
I20260204 09:11:02.768476 10489 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:02.768563 10489 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:11:02.769315 10489 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:02.769477 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 5 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 3. Current term is 5. Ops: []
I20260204 09:11:02.769503 10489 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 5 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:02.769667 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 40 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:02.769672 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 40 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:02.769703 10494 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 3.40, Next index: 41, Last known committed idx: 40, Time since last communication: 0.000s
I20260204 09:11:02.769887 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:02.769966 10489 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260204 09:11:02.773981 10452 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 3 LEADER]: Stepping down as leader of term 3
I20260204 09:11:02.774019 10452 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:02.774065 10452 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 40, Committed index: 40, Last appended: 3.40, Last appended by leader: 40, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:02.774140 10452 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 3 FOLLOWER]: Advancing to term 4
I20260204 09:11:02.857178 10493 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:02.857270 10493 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 3 FOLLOWER]: Advancing to term 4
I20260204 09:11:02.857959 10493 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:02.858105 10493 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 4 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:02.858323 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 40 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:02.858323 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 40 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:02.858431 10322 raft_consensus.cc:2368] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 4. Current term is 5.
I20260204 09:11:02.858582 10363 leader_election.cc:400] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 4 election: Vote denied by peer bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259) with higher term. Message: Invalid argument: T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 4. Current term is 5.
I20260204 09:11:02.858616 10363 leader_election.cc:403] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260204 09:11:02.858668 10493 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:11:02.859071 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 4.
I20260204 09:11:02.859220 10493 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259) with higher term. Message: Invalid argument: T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 4. Current term is 5.
I20260204 09:11:02.961381 10489 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:02.961478 10489 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:11:02.962081 10489 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:02.962226 10489 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 6 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:02.962433 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 40 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:02.962433 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 40 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:02.962556 10246 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 4 FOLLOWER]: Advancing to term 6
I20260204 09:11:02.962559 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:11:02.963280 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 6.
I20260204 09:11:02.963280 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 6.
I20260204 09:11:02.963469 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters:
I20260204 09:11:02.963548 10489 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 6 FOLLOWER]: Leader election won for term 6
I20260204 09:11:02.963663 10489 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 6 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:02.963726 10489 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 40, Committed index: 40, Last appended: 3.40, Last appended by leader: 40, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:02.964154 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 3 to 6, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 6 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:03.049465 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 6 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 40. Preceding OpId from leader: term: 6 index: 41. (index mismatch)
I20260204 09:11:03.049733 10489 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 41, Last known committed idx: 40, Time since last communication: 0.000s
I20260204 09:11:03.051384 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 6 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 40. Preceding OpId from leader: term: 6 index: 41. (index mismatch)
I20260204 09:11:03.051563 10489 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 41, Last known committed idx: 40, Time since last communication: 0.000s
I20260204 09:11:03.331271 10452 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:03.331364 10452 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:11:03.335784 10452 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:03.335973 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 7 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 6. Current term is 7. Ops: []
I20260204 09:11:03.336087 10452 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 7 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:03.336189 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 7 candidate_status { last_received { term: 6 index: 41 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:03.336233 10497 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 6.41, Next index: 42, Last known committed idx: 41, Time since last communication: 0.000s
I20260204 09:11:03.336264 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 7 candidate_status { last_received { term: 6 index: 41 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:03.336549 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11502cf05241427fb9853e628add7746; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:03.336629 10452 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260204 09:11:03.414429 10493 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:03.414523 10493 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:11:03.415150 10493 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:03.415318 10493 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 7 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:03.415504 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 41 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:03.415511 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 41 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:03.415584 10246 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in current term 7: Already voted for candidate 11502cf05241427fb9853e628add7746 in this term.
I20260204 09:11:03.415735 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:03.415822 10493 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260204 09:11:03.426301 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 7 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 6. Current term is 7. Ops: []
I20260204 09:11:03.426496 10497 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 6.41, Next index: 42, Last known committed idx: 41, Time since last communication: 0.000s
I20260204 09:11:03.431538 10495 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 6 LEADER]: Stepping down as leader of term 6
I20260204 09:11:03.431586 10495 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:03.431638 10495 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 41, Committed index: 41, Last appended: 6.41, Last appended by leader: 41, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:03.431720 10495 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:11:03.442833 10452 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:03.442919 10452 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 7 FOLLOWER]: Advancing to term 8
I20260204 09:11:03.443571 10452 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:03.443725 10452 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 8 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:03.443913 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 8 candidate_status { last_received { term: 6 index: 41 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:03.443926 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 8 candidate_status { last_received { term: 6 index: 41 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:03.443984 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 7 FOLLOWER]: Advancing to term 8
I20260204 09:11:03.444022 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 7 FOLLOWER]: Advancing to term 8
I20260204 09:11:03.444505 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 8.
I20260204 09:11:03.444554 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 8.
I20260204 09:11:03.444669 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters:
I20260204 09:11:03.444759 10452 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 8 FOLLOWER]: Leader election won for term 8
I20260204 09:11:03.444872 10452 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 8 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:03.444916 10452 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 41, Committed index: 41, Last appended: 6.41, Last appended by leader: 41, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:03.445334 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 6 to 8, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 8 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:03.532634 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 8 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 6 index: 41. Preceding OpId from leader: term: 8 index: 42. (index mismatch)
I20260204 09:11:03.532878 10452 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 42, Last known committed idx: 41, Time since last communication: 0.000s
I20260204 09:11:03.553086 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 8 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 6 index: 41. Preceding OpId from leader: term: 8 index: 42. (index mismatch)
I20260204 09:11:03.553320 10452 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 42, Last known committed idx: 41, Time since last communication: 0.000s
I20260204 09:11:03.634877 10493 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:03.634965 10493 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 8 FOLLOWER]: Advancing to term 9
I20260204 09:11:03.635589 10493 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:03.635748 10493 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 9 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:03.635970 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 42 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:03.635974 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 42 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:03.636233 10362 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:03.636341 10493 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260204 09:11:03.658943 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 9 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 8. Current term is 9. Ops: []
I20260204 09:11:03.659178 10498 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 8.42, Next index: 43, Last known committed idx: 42, Time since last communication: 0.000s
I20260204 09:11:03.748359 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 9 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 8. Current term is 9. Ops: []
I20260204 09:11:03.748416 10495 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:03.748483 10495 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 8 FOLLOWER]: Advancing to term 9
I20260204 09:11:03.748626 10452 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 8.42, Next index: 43, Last known committed idx: 42, Time since last communication: 0.000s
I20260204 09:11:03.749194 10495 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:03.749312 10495 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 9 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:03.749495 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 42 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:03.749480 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 42 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:03.749593 10397 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bd38b0e96f264071a69be73b6b4f14c1 in current term 9: Already voted for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in this term.
I20260204 09:11:03.749716 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:03.749799 10495 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260204 09:11:03.751791 10499 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 8 LEADER]: Stepping down as leader of term 8
I20260204 09:11:03.751827 10499 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:03.751881 10499 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 42, Committed index: 42, Last appended: 8.42, Last appended by leader: 42, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:03.751967 10499 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 8 FOLLOWER]: Advancing to term 9
I20260204 09:11:03.752856 10493 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:03.752902 10493 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 9 FOLLOWER]: Advancing to term 10
I20260204 09:11:03.753412 10493 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:03.753528 10493 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 10 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:03.753662 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 42 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:03.753664 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 42 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:03.753724 10246 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 9 FOLLOWER]: Advancing to term 10
I20260204 09:11:03.753739 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 9 FOLLOWER]: Advancing to term 10
I20260204 09:11:03.754184 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 10.
I20260204 09:11:03.754227 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 10.
I20260204 09:11:03.754338 10362 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters:
I20260204 09:11:03.754408 10493 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260204 09:11:03.754520 10493 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 10 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:03.754568 10493 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 42, Committed index: 42, Last appended: 8.42, Last appended by leader: 42, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:03.754982 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 8 to 10, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 10 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:03.838348 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 10 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 42. Preceding OpId from leader: term: 10 index: 43. (index mismatch)
I20260204 09:11:03.838596 10493 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 43, Last known committed idx: 42, Time since last communication: 0.000s
I20260204 09:11:03.844254 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 10 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 42. Preceding OpId from leader: term: 10 index: 43. (index mismatch)
I20260204 09:11:03.844446 10493 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 43, Last known committed idx: 42, Time since last communication: 0.000s
I20260204 09:11:03.945750 10495 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:03.945838 10495 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 10 FOLLOWER]: Advancing to term 11
I20260204 09:11:03.946470 10495 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:03.946621 10495 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 11 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:03.946851 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 43 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:03.946870 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 43 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:03.946960 10246 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 10 FOLLOWER]: Advancing to term 11
I20260204 09:11:03.947503 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 11.
I20260204 09:11:03.947655 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:03.947738 10495 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 11 FOLLOWER]: Leader election won for term 11
I20260204 09:11:03.947829 10495 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 11 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:03.947877 10495 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 43, Committed index: 43, Last appended: 10.43, Last appended by leader: 43, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:03.948323 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 10 to 11, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 11 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:03.951231 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:03.952425 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:03.954538 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:03.958671 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:03.961460 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 11 LEADER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 10. Current term is 11. Ops: []
I20260204 09:11:03.961642 10500 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 10.43, Next index: 44, Last known committed idx: 43, Time since last communication: 0.000s
I20260204 09:11:03.961714 10500 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer bd38b0e96f264071a69be73b6b4f14c1 log is divergent from this leader: its last log entry 11.44 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 43
I20260204 09:11:03.961747 10501 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260204 09:11:03.961786 10501 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:03.961843 10501 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 43, Committed index: 43, Last appended: 10.43, Last appended by leader: 43, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:03.961921 10501 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 10 FOLLOWER]: Advancing to term 11
I20260204 09:11:03.966836 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:03.983016 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:04.015239 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:04.033684 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 11 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 10 index: 43. Preceding OpId from leader: term: 11 index: 44. (index mismatch)
I20260204 09:11:04.033939 10495 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 44, Last known committed idx: 43, Time since last communication: 0.000s
I20260204 09:11:04.034900 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 11 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 10 index: 43. Preceding OpId from leader: term: 11 index: 44. (index mismatch)
I20260204 09:11:04.035074 10503 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 44, Last known committed idx: 43, Time since last communication: 0.000s
I20260204 09:11:04.079452 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:04.207667 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:04.307523 10501 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:04.307621 10501 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 11 FOLLOWER]: Advancing to term 12
I20260204 09:11:04.308290 10501 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:04.308580 10501 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 12 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:04.308662 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 44 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:04.308698 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 44 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:04.308969 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:04.309080 10501 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260204 09:11:04.320992 10499 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:04.321067 10499 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 11 FOLLOWER]: Advancing to term 12
I20260204 09:11:04.321700 10499 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:04.321837 10499 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 12 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:04.322012 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 12 candidate_status { last_received { term: 11 index: 44 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:04.322012 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 12 candidate_status { last_received { term: 11 index: 44 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:04.322103 10397 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 11502cf05241427fb9853e628add7746 in current term 12: Already voted for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in this term.
I20260204 09:11:04.322258 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11502cf05241427fb9853e628add7746; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:04.322352 10499 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260204 09:11:04.327593 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 12 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 11. Current term is 12. Ops: []
I20260204 09:11:04.327791 10502 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 11.44, Next index: 45, Last known committed idx: 44, Time since last communication: 0.000s
I20260204 09:11:04.327899 10502 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 11 LEADER]: Stepping down as leader of term 11
I20260204 09:11:04.327934 10502 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:04.327986 10502 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 44, Committed index: 44, Last appended: 11.44, Last appended by leader: 44, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:04.328065 10502 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 11 FOLLOWER]: Advancing to term 12
I20260204 09:11:04.413437 10501 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:04.413535 10501 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 12 FOLLOWER]: Advancing to term 13
I20260204 09:11:04.414191 10501 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:04.414361 10501 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 13 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:04.414561 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 44 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:04.414626 10246 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 12 FOLLOWER]: Advancing to term 13
I20260204 09:11:04.414570 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 44 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:04.414670 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 12 FOLLOWER]: Advancing to term 13
I20260204 09:11:04.415141 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 13.
I20260204 09:11:04.415231 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 13.
I20260204 09:11:04.415329 10362 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters:
I20260204 09:11:04.415422 10501 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260204 09:11:04.415477 10501 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 13 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:04.415525 10501 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 44, Committed index: 44, Last appended: 11.44, Last appended by leader: 44, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:04.415957 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 11 to 13, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 13 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:04.463881 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:04.521287 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 13 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 44. Preceding OpId from leader: term: 13 index: 45. (index mismatch)
I20260204 09:11:04.521540 10501 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 45, Last known committed idx: 44, Time since last communication: 0.000s
I20260204 09:11:04.522437 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 13 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 44. Preceding OpId from leader: term: 13 index: 45. (index mismatch)
I20260204 09:11:04.522643 10501 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 45, Last known committed idx: 44, Time since last communication: 0.000s
I20260204 09:11:04.623821 10499 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:04.623920 10499 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 13 FOLLOWER]: Advancing to term 14
I20260204 09:11:04.624501 10499 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:04.624642 10499 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 14 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:04.624830 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 14 candidate_status { last_received { term: 13 index: 45 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:04.624830 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 14 candidate_status { last_received { term: 13 index: 45 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:04.625061 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11502cf05241427fb9853e628add7746; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:04.625149 10499 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260204 09:11:04.630805 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 14 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 13. Current term is 14. Ops: []
I20260204 09:11:04.631037 10505 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 13.45, Next index: 46, Last known committed idx: 45, Time since last communication: 0.000s
I20260204 09:11:04.631135 10505 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260204 09:11:04.631167 10505 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:04.631222 10505 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 45, Committed index: 45, Last appended: 13.45, Last appended by leader: 45, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:04.631297 10505 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 13 FOLLOWER]: Advancing to term 14
I20260204 09:11:04.713816 10502 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:04.713908 10502 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 13 FOLLOWER]: Advancing to term 14
I20260204 09:11:04.714540 10502 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:04.714679 10502 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 14 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:04.714908 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 45 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:04.714908 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 14 candidate_status { last_received { term: 13 index: 45 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:04.715037 10246 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bd38b0e96f264071a69be73b6b4f14c1 in current term 14: Already voted for candidate 11502cf05241427fb9853e628add7746 in this term.
I20260204 09:11:04.715545 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 14.
I20260204 09:11:04.715708 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:04.715788 10502 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 14 FOLLOWER]: Leader election won for term 14
I20260204 09:11:04.715847 10502 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 14 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:04.715907 10502 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 45, Committed index: 45, Last appended: 13.45, Last appended by leader: 45, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:04.716341 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 13 to 14, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 14 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:04.767592 10499 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:04.767683 10499 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 14 FOLLOWER]: Advancing to term 15
I20260204 09:11:04.768318 10499 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:04.768481 10499 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 15 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:04.768682 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 15 candidate_status { last_received { term: 13 index: 45 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:04.768682 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 15 candidate_status { last_received { term: 13 index: 45 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:04.768784 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 14 FOLLOWER]: Advancing to term 15
I20260204 09:11:04.769313 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 15.
I20260204 09:11:04.769484 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:04.769587 10499 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 15 FOLLOWER]: Leader election won for term 15
I20260204 09:11:04.769693 10499 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 15 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:04.769740 10499 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 45, Committed index: 45, Last appended: 13.45, Last appended by leader: 45, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:04.770152 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 14 to 15, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 15 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:04.806615 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 15 LEADER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 14. Current term is 15. Ops: []
I20260204 09:11:04.806871 10502 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 46, Last known committed idx: 45, Time since last communication: 0.000s
I20260204 09:11:04.806986 10502 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer 11502cf05241427fb9853e628add7746 log is divergent from this leader: its last log entry 15.46 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 45
I20260204 09:11:04.807009 10502 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 14 LEADER]: Stepping down as leader of term 14
I20260204 09:11:04.807035 10502 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:04.807089 10502 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 45, Committed index: 45, Last appended: 14.46, Last appended by leader: 46, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:04.807160 10502 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 14 FOLLOWER]: Advancing to term 15
I20260204 09:11:04.879473 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 15 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 13 index: 45. Preceding OpId from leader: term: 15 index: 46. (index mismatch)
I20260204 09:11:04.879703 10499 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 46, Last known committed idx: 45, Time since last communication: 0.000s
I20260204 09:11:04.880620 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 15 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 14 index: 46. Preceding OpId from leader: term: 15 index: 46. (term mismatch)
I20260204 09:11:04.880676 10322 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Aborting all ops after (but not including) 45
I20260204 09:11:04.880709 10322 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Aborting uncommitted NO_OP operation due to leader change: 14.46
I20260204 09:11:04.880740 10322 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:04.880923 10507 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 46, Last known committed idx: 45, Time since last communication: 0.000s
I20260204 09:11:04.976114 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:04.981235 10505 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:04.981293 10505 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 15 FOLLOWER]: Advancing to term 16
I20260204 09:11:04.981961 10505 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:04.982133 10505 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 16 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:04.982323 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 46 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:04.982334 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 46 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:04.982411 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 15 FOLLOWER]: Advancing to term 16
I20260204 09:11:04.982970 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 16.
I20260204 09:11:04.983134 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:04.983219 10505 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 16 FOLLOWER]: Leader election won for term 16
I20260204 09:11:04.983266 10505 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 16 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:04.983337 10505 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 46, Committed index: 46, Last appended: 15.46, Last appended by leader: 46, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:04.983747 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 15 to 16, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 16 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:04.992903 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 16 LEADER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 15. Current term is 16. Ops: []
I20260204 09:11:04.993109 10507 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 15.46, Next index: 47, Last known committed idx: 46, Time since last communication: 0.000s
I20260204 09:11:04.993201 10507 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer 8b12f9075d9d4ffa9fd711322da0c4d2 log is divergent from this leader: its last log entry 16.47 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 46
I20260204 09:11:04.993237 10506 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 15 LEADER]: Stepping down as leader of term 15
I20260204 09:11:04.993275 10506 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:04.993322 10506 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 46, Committed index: 46, Last appended: 15.46, Last appended by leader: 46, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:04.993428 10506 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 15 FOLLOWER]: Advancing to term 16
I20260204 09:11:05.085091 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 16 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 46. Preceding OpId from leader: term: 16 index: 47. (index mismatch)
I20260204 09:11:05.085330 10505 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 47, Last known committed idx: 46, Time since last communication: 0.000s
I20260204 09:11:05.086231 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 16 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 46. Preceding OpId from leader: term: 16 index: 47. (index mismatch)
I20260204 09:11:05.086511 10500 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 47, Last known committed idx: 46, Time since last communication: 0.000s
I20260204 09:11:05.186908 10502 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:05.187003 10502 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 16 FOLLOWER]: Advancing to term 17
I20260204 09:11:05.187628 10502 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:05.187772 10502 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 17 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:05.187994 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 17 candidate_status { last_received { term: 16 index: 47 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:05.187987 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 17 candidate_status { last_received { term: 16 index: 47 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:05.188208 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:05.188287 10502 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260204 09:11:05.200790 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 17 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 16. Current term is 17. Ops: []
I20260204 09:11:05.201021 10500 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 16.47, Next index: 48, Last known committed idx: 47, Time since last communication: 0.000s
I20260204 09:11:05.201145 10500 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 16 LEADER]: Stepping down as leader of term 16
I20260204 09:11:05.201179 10500 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:05.201226 10500 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 47, Committed index: 47, Last appended: 16.47, Last appended by leader: 47, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:05.201303 10500 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 16 FOLLOWER]: Advancing to term 17
I20260204 09:11:05.265983 10506 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:05.266076 10506 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 16 FOLLOWER]: Advancing to term 17
I20260204 09:11:05.266678 10506 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:05.266824 10506 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 17 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:05.267019 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 17 candidate_status { last_received { term: 16 index: 47 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:05.267019 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 17 candidate_status { last_received { term: 16 index: 47 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:05.267154 10322 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 11502cf05241427fb9853e628add7746 in current term 17: Already voted for candidate bd38b0e96f264071a69be73b6b4f14c1 in this term.
I20260204 09:11:05.267663 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 17.
I20260204 09:11:05.267834 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:05.267922 10506 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 17 FOLLOWER]: Leader election won for term 17
I20260204 09:11:05.267975 10506 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 17 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:05.268026 10506 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 47, Committed index: 47, Last appended: 16.47, Last appended by leader: 47, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:05.268443 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 16 to 17, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 17 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:05.302429 10502 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:05.302515 10502 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 17 FOLLOWER]: Advancing to term 18
I20260204 09:11:05.303135 10502 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:05.303273 10502 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 18 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:05.303485 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 18 candidate_status { last_received { term: 16 index: 47 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:05.303491 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 18 candidate_status { last_received { term: 16 index: 47 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:05.303570 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 17 FOLLOWER]: Advancing to term 18
I20260204 09:11:05.304114 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 18.
I20260204 09:11:05.304273 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:05.304352 10502 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 18 FOLLOWER]: Leader election won for term 18
I20260204 09:11:05.304423 10502 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 18 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:05.304473 10502 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 47, Committed index: 47, Last appended: 16.47, Last appended by leader: 47, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:05.304900 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 17 to 18, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 18 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:05.349722 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 18 LEADER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 17. Current term is 18. Ops: []
I20260204 09:11:05.349992 10506 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 0.0, Next index: 48, Last known committed idx: 47, Time since last communication: 0.000s
I20260204 09:11:05.350085 10506 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer bd38b0e96f264071a69be73b6b4f14c1 log is divergent from this leader: its last log entry 18.48 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 47
I20260204 09:11:05.350114 10507 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 17 LEADER]: Stepping down as leader of term 17
I20260204 09:11:05.350162 10507 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:05.350214 10507 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 47, Committed index: 47, Last appended: 17.48, Last appended by leader: 48, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:05.350288 10507 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 17 FOLLOWER]: Advancing to term 18
I20260204 09:11:05.383198 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 18 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 16 index: 47. Preceding OpId from leader: term: 18 index: 48. (index mismatch)
I20260204 09:11:05.383437 10502 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 48, Last known committed idx: 47, Time since last communication: 0.000s
I20260204 09:11:05.384336 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 18 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 17 index: 48. Preceding OpId from leader: term: 18 index: 48. (term mismatch)
I20260204 09:11:05.384390 10246 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting all ops after (but not including) 47
I20260204 09:11:05.384407 10246 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting uncommitted NO_OP operation due to leader change: 17.48
I20260204 09:11:05.384424 10246 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:05.384562 10502 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 48, Last known committed idx: 47, Time since last communication: 0.000s
I20260204 09:11:05.485242 10500 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:05.485317 10500 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 18 FOLLOWER]: Advancing to term 19
I20260204 09:11:05.485937 10500 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:05.486073 10500 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 19 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:05.486248 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 48 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:05.486231 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 48 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:05.486492 10362 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:05.486567 10500 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260204 09:11:05.494504 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 19 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 18. Current term is 19. Ops: []
I20260204 09:11:05.494719 10508 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 18.48, Next index: 49, Last known committed idx: 48, Time since last communication: 0.000s
I20260204 09:11:05.494820 10508 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 18 LEADER]: Stepping down as leader of term 18
I20260204 09:11:05.494851 10508 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:05.494905 10508 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 48, Committed index: 48, Last appended: 18.48, Last appended by leader: 48, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:05.494966 10508 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 18 FOLLOWER]: Advancing to term 19
I20260204 09:11:05.582720 10506 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:05.582814 10506 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 18 FOLLOWER]: Advancing to term 19
I20260204 09:11:05.583423 10506 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:05.583575 10506 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 19 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:05.583793 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 19 candidate_status { last_received { term: 18 index: 48 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:05.583798 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 19 candidate_status { last_received { term: 18 index: 48 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:05.583886 10397 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 11502cf05241427fb9853e628add7746 in current term 19: Already voted for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in this term.
I20260204 09:11:05.584475 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 19.
I20260204 09:11:05.584628 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:05.584717 10506 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 19 FOLLOWER]: Leader election won for term 19
I20260204 09:11:05.584764 10506 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 19 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:05.584810 10506 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 48, Committed index: 48, Last appended: 18.48, Last appended by leader: 48, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:05.585237 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 18 to 19, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 19 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:05.602313 10500 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:05.602391 10500 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 19 FOLLOWER]: Advancing to term 20
I20260204 09:11:05.602967 10500 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:05.603112 10500 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 20 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:05.603289 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 48 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:05.603294 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 48 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:05.603379 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 19 FOLLOWER]: Advancing to term 20
I20260204 09:11:05.603878 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 20.
I20260204 09:11:05.604025 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:05.604115 10500 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 20 FOLLOWER]: Leader election won for term 20
I20260204 09:11:05.604168 10500 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 20 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:05.604216 10500 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 48, Committed index: 48, Last appended: 18.48, Last appended by leader: 48, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:05.604583 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 19 to 20, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 20 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:05.691592 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 20 LEADER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 19. Current term is 20. Ops: []
I20260204 09:11:05.691850 10506 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 49, Last known committed idx: 48, Time since last communication: 0.000s
I20260204 09:11:05.691963 10506 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer 8b12f9075d9d4ffa9fd711322da0c4d2 log is divergent from this leader: its last log entry 20.49 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 48
I20260204 09:11:05.691992 10507 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 19 LEADER]: Stepping down as leader of term 19
I20260204 09:11:05.692031 10507 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:05.692087 10507 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 48, Committed index: 48, Last appended: 19.49, Last appended by leader: 49, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:05.692175 10507 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 19 FOLLOWER]: Advancing to term 20
I20260204 09:11:05.718842 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 20 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 48. Preceding OpId from leader: term: 20 index: 49. (index mismatch)
I20260204 09:11:05.719105 10500 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 49, Last known committed idx: 48, Time since last communication: 0.000s
I20260204 09:11:05.720202 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 20 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 49. Preceding OpId from leader: term: 20 index: 49. (term mismatch)
I20260204 09:11:05.720252 10246 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting all ops after (but not including) 48
I20260204 09:11:05.720269 10246 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting uncommitted NO_OP operation due to leader change: 19.49
I20260204 09:11:05.720288 10246 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:05.720445 10509 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 49, Last known committed idx: 48, Time since last communication: 0.000s
I20260204 09:11:05.820456 10508 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:05.820554 10508 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 20 FOLLOWER]: Advancing to term 21
I20260204 09:11:05.821233 10508 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:05.821409 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 21 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 20. Current term is 21. Ops: []
I20260204 09:11:05.821424 10508 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 21 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:05.821590 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 21 candidate_status { last_received { term: 20 index: 49 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:05.821643 10500 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 20.49, Next index: 50, Last known committed idx: 49, Time since last communication: 0.000s
I20260204 09:11:05.821599 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 21 candidate_status { last_received { term: 20 index: 49 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:05.821712 10246 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 20 FOLLOWER]: Advancing to term 21
I20260204 09:11:05.821710 10500 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 20 LEADER]: Stepping down as leader of term 20
I20260204 09:11:05.821763 10500 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:05.821812 10500 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 49, Committed index: 49, Last appended: 20.49, Last appended by leader: 49, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:05.821895 10500 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 20 FOLLOWER]: Advancing to term 21
I20260204 09:11:05.822306 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 21.
I20260204 09:11:05.822479 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:05.822563 10508 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 21 FOLLOWER]: Leader election won for term 21
I20260204 09:11:05.822607 10508 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 21 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:05.822693 10508 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 49, Committed index: 49, Last appended: 20.49, Last appended by leader: 49, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:05.823096 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 20 to 21, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 21 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:05.910351 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 21 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 20 index: 49. Preceding OpId from leader: term: 21 index: 50. (index mismatch)
I20260204 09:11:05.910607 10508 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 50, Last known committed idx: 49, Time since last communication: 0.000s
I20260204 09:11:05.911571 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 21 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 20 index: 49. Preceding OpId from leader: term: 21 index: 50. (index mismatch)
I20260204 09:11:05.911743 10508 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 50, Last known committed idx: 49, Time since last communication: 0.000s
I20260204 09:11:05.976353 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:06.012714 10507 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 21 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:06.012811 10507 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 21 FOLLOWER]: Advancing to term 22
I20260204 09:11:06.013499 10507 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:06.013654 10507 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 22 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:06.013849 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 22 candidate_status { last_received { term: 21 index: 50 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:06.013861 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 22 candidate_status { last_received { term: 21 index: 50 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:06.014050 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11502cf05241427fb9853e628add7746; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:06.014139 10507 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260204 09:11:06.032712 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 22 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 21. Current term is 22. Ops: []
I20260204 09:11:06.032974 10502 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 21.50, Next index: 51, Last known committed idx: 50, Time since last communication: 0.000s
I20260204 09:11:06.033087 10502 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 21 LEADER]: Stepping down as leader of term 21
I20260204 09:11:06.033115 10502 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:06.033169 10502 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 50, Committed index: 50, Last appended: 21.50, Last appended by leader: 50, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:06.033242 10502 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 21 FOLLOWER]: Advancing to term 22
I20260204 09:11:06.095489 10500 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 21 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:06.095582 10500 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 21 FOLLOWER]: Advancing to term 22
I20260204 09:11:06.096213 10500 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:06.096375 10500 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 22 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:06.096561 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 50 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:06.096565 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 50 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:06.096644 10246 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in current term 22: Already voted for candidate 11502cf05241427fb9853e628add7746 in this term.
I20260204 09:11:06.097193 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 22.
I20260204 09:11:06.097368 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:06.097465 10500 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 22 FOLLOWER]: Leader election won for term 22
I20260204 09:11:06.097537 10500 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 22 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:06.097589 10500 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 50, Committed index: 50, Last appended: 21.50, Last appended by leader: 50, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:06.097968 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 21 to 22, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 22 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:06.156299 10507 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:06.156400 10507 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 22 FOLLOWER]: Advancing to term 23
I20260204 09:11:06.157053 10507 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:06.157228 10507 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 23 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:06.157441 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 23 candidate_status { last_received { term: 21 index: 50 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:06.157441 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 23 candidate_status { last_received { term: 21 index: 50 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:06.157593 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 22 FOLLOWER]: Advancing to term 23
I20260204 09:11:06.158126 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 23.
I20260204 09:11:06.158280 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:06.158363 10507 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 23 FOLLOWER]: Leader election won for term 23
I20260204 09:11:06.158419 10507 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 23 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:06.158471 10507 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 50, Committed index: 50, Last appended: 21.50, Last appended by leader: 50, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:06.158893 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 22 to 23, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 23 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:06.173103 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 23 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 22. Current term is 23. Ops: []
I20260204 09:11:06.173326 10500 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 0.0, Next index: 51, Last known committed idx: 50, Time since last communication: 0.000s
I20260204 09:11:06.173449 10500 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 22 LEADER]: Stepping down as leader of term 22
I20260204 09:11:06.173482 10500 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:06.173533 10500 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 50, Committed index: 50, Last appended: 22.51, Last appended by leader: 51, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:06.173601 10500 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 22 FOLLOWER]: Advancing to term 23
I20260204 09:11:06.254302 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 23 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 21 index: 50. Preceding OpId from leader: term: 23 index: 51. (index mismatch)
I20260204 09:11:06.254552 10507 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 51, Last known committed idx: 50, Time since last communication: 0.000s
I20260204 09:11:06.255524 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 23 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 22 index: 51. Preceding OpId from leader: term: 23 index: 51. (term mismatch)
I20260204 09:11:06.255574 10397 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2: Aborting all ops after (but not including) 50
I20260204 09:11:06.255592 10397 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2: Aborting uncommitted NO_OP operation due to leader change: 22.51
I20260204 09:11:06.255621 10397 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:06.255784 10510 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 51, Last known committed idx: 50, Time since last communication: 0.000s
I20260204 09:11:06.356009 10502 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:06.356103 10502 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 23 FOLLOWER]: Advancing to term 24
I20260204 09:11:06.356743 10502 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:06.356907 10502 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 24 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:06.357120 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 24 candidate_status { last_received { term: 23 index: 51 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:06.357191 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 23 FOLLOWER]: Advancing to term 24
I20260204 09:11:06.357149 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 24 candidate_status { last_received { term: 23 index: 51 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:06.357895 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 24.
I20260204 09:11:06.358107 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:06.358207 10502 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 24 FOLLOWER]: Leader election won for term 24
I20260204 09:11:06.358271 10502 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 24 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:06.358323 10502 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 51, Committed index: 51, Last appended: 23.51, Last appended by leader: 51, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:06.361057 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 23 to 24, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 24 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:06.378031 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 24 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 23. Current term is 24. Ops: []
I20260204 09:11:06.378247 10507 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 23.51, Next index: 52, Last known committed idx: 51, Time since last communication: 0.000s
I20260204 09:11:06.378364 10507 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 23 LEADER]: Stepping down as leader of term 23
I20260204 09:11:06.378396 10507 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:06.378453 10507 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 51, Committed index: 51, Last appended: 23.51, Last appended by leader: 51, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:06.378512 10507 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 23 FOLLOWER]: Advancing to term 24
I20260204 09:11:06.438179 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 24 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 23 index: 51. Preceding OpId from leader: term: 24 index: 52. (index mismatch)
I20260204 09:11:06.438433 10508 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 52, Last known committed idx: 51, Time since last communication: 0.000s
I20260204 09:11:06.439385 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 24 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 23 index: 51. Preceding OpId from leader: term: 24 index: 52. (index mismatch)
I20260204 09:11:06.439563 10502 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 52, Last known committed idx: 51, Time since last communication: 0.000s
I20260204 09:11:06.539733 10500 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 24 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:06.539842 10500 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 24 FOLLOWER]: Advancing to term 25
I20260204 09:11:06.540455 10500 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:06.540616 10500 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 25 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:06.540818 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 25 candidate_status { last_received { term: 24 index: 52 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:06.540818 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 25 candidate_status { last_received { term: 24 index: 52 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:06.540935 10246 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 24 FOLLOWER]: Advancing to term 25
I20260204 09:11:06.541504 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 25.
I20260204 09:11:06.541657 10362 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:06.541750 10500 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 25 FOLLOWER]: Leader election won for term 25
I20260204 09:11:06.541803 10500 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 25 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:06.541853 10500 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 52, Committed index: 52, Last appended: 24.52, Last appended by leader: 52, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:06.542273 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 24 to 25, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 25 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:06.549324 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 25 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 24. Current term is 25. Ops: []
I20260204 09:11:06.549544 10495 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 24.52, Next index: 53, Last known committed idx: 52, Time since last communication: 0.000s
I20260204 09:11:06.549634 10495 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 24 LEADER]: Stepping down as leader of term 24
I20260204 09:11:06.549657 10495 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:06.549713 10495 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 52, Committed index: 52, Last appended: 24.52, Last appended by leader: 52, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:06.549784 10495 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 24 FOLLOWER]: Advancing to term 25
I20260204 09:11:06.658696 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 25 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 24 index: 52. Preceding OpId from leader: term: 25 index: 53. (index mismatch)
I20260204 09:11:06.658958 10500 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 53, Last known committed idx: 52, Time since last communication: 0.000s
I20260204 09:11:06.659999 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 25 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 24 index: 52. Preceding OpId from leader: term: 25 index: 53. (index mismatch)
I20260204 09:11:06.660233 10500 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 53, Last known committed idx: 52, Time since last communication: 0.000s
I20260204 09:11:06.852494 10507 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:06.852588 10507 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 25 FOLLOWER]: Advancing to term 26
I20260204 09:11:06.853253 10507 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:06.853441 10507 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 26 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:06.853631 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 26 candidate_status { last_received { term: 25 index: 53 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:06.853634 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 26 candidate_status { last_received { term: 25 index: 53 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:06.853864 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11502cf05241427fb9853e628add7746; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:06.853945 10507 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260204 09:11:06.876392 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 26 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 25. Current term is 26. Ops: []
I20260204 09:11:06.876657 10511 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 25.53, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260204 09:11:06.876796 10509 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 25 LEADER]: Stepping down as leader of term 25
I20260204 09:11:06.876852 10509 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:06.876917 10509 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 53, Committed index: 53, Last appended: 25.53, Last appended by leader: 53, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:06.877007 10509 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 25 FOLLOWER]: Advancing to term 26
I20260204 09:11:06.943675 10495 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:06.943765 10495 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 25 FOLLOWER]: Advancing to term 26
I20260204 09:11:06.944381 10495 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:06.944521 10495 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 26 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:06.944768 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 26 candidate_status { last_received { term: 25 index: 53 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:06.944767 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 26 candidate_status { last_received { term: 25 index: 53 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:06.944880 10246 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate bd38b0e96f264071a69be73b6b4f14c1 in current term 26: Already voted for candidate 11502cf05241427fb9853e628add7746 in this term.
I20260204 09:11:06.945395 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 26.
I20260204 09:11:06.945556 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:06.945641 10495 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 26 FOLLOWER]: Leader election won for term 26
I20260204 09:11:06.945698 10495 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 26 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:06.945742 10495 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 53, Committed index: 53, Last appended: 25.53, Last appended by leader: 53, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:06.946162 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 25 to 26, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 26 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:06.962179 10507 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:06.962268 10507 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 26 FOLLOWER]: Advancing to term 27
I20260204 09:11:06.962874 10507 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:06.963037 10507 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 27 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:06.963227 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 27 candidate_status { last_received { term: 25 index: 53 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:06.963215 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 27 candidate_status { last_received { term: 25 index: 53 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:06.963327 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 26 FOLLOWER]: Advancing to term 27
I20260204 09:11:06.963860 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 27.
I20260204 09:11:06.964032 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:06.964124 10507 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 27 FOLLOWER]: Leader election won for term 27
I20260204 09:11:06.964221 10507 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 27 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:06.964273 10507 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 53, Committed index: 53, Last appended: 25.53, Last appended by leader: 53, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:06.964715 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 26 to 27, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 27 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:06.976593 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:07.042444 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 27 LEADER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 26. Current term is 27. Ops: []
I20260204 09:11:07.042691 10495 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260204 09:11:07.042791 10495 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer 11502cf05241427fb9853e628add7746 log is divergent from this leader: its last log entry 27.54 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 53
I20260204 09:11:07.042843 10502 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 26 LEADER]: Stepping down as leader of term 26
I20260204 09:11:07.042903 10502 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:07.042964 10502 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 53, Committed index: 53, Last appended: 26.54, Last appended by leader: 54, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:07.043052 10502 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 26 FOLLOWER]: Advancing to term 27
I20260204 09:11:07.062121 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 27 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 25 index: 53. Preceding OpId from leader: term: 27 index: 54. (index mismatch)
I20260204 09:11:07.062424 10507 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260204 09:11:07.063370 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 27 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 26 index: 54. Preceding OpId from leader: term: 27 index: 54. (term mismatch)
I20260204 09:11:07.063421 10322 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Aborting all ops after (but not including) 53
I20260204 09:11:07.063439 10322 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Aborting uncommitted NO_OP operation due to leader change: 26.54
I20260204 09:11:07.063457 10322 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:07.063601 10507 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260204 09:11:07.164054 10509 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:07.164160 10509 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 27 FOLLOWER]: Advancing to term 28
I20260204 09:11:07.164773 10509 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:07.164930 10509 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 28 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:07.165124 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 28 candidate_status { last_received { term: 27 index: 54 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:07.165138 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 28 candidate_status { last_received { term: 27 index: 54 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:07.165235 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 27 FOLLOWER]: Advancing to term 28
I20260204 09:11:07.165784 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 28.
I20260204 09:11:07.165933 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:07.166013 10509 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 28 FOLLOWER]: Leader election won for term 28
I20260204 09:11:07.166075 10509 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 28 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:07.166129 10509 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 54, Committed index: 54, Last appended: 27.54, Last appended by leader: 54, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:07.166553 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 27 to 28, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 28 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:07.175326 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 28 LEADER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 27. Current term is 28. Ops: []
I20260204 09:11:07.175518 10507 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 27.54, Next index: 55, Last known committed idx: 54, Time since last communication: 0.000s
I20260204 09:11:07.175580 10507 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer 8b12f9075d9d4ffa9fd711322da0c4d2 log is divergent from this leader: its last log entry 28.55 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 54
I20260204 09:11:07.175613 10512 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 27 LEADER]: Stepping down as leader of term 27
I20260204 09:11:07.175652 10512 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:07.175697 10512 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 54, Committed index: 54, Last appended: 27.54, Last appended by leader: 54, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:07.175770 10512 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 27 FOLLOWER]: Advancing to term 28
I20260204 09:11:07.258086 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 28 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 27 index: 54. Preceding OpId from leader: term: 28 index: 55. (index mismatch)
I20260204 09:11:07.258325 10509 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 55, Last known committed idx: 54, Time since last communication: 0.000s
I20260204 09:11:07.259243 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 28 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 27 index: 54. Preceding OpId from leader: term: 28 index: 55. (index mismatch)
I20260204 09:11:07.259410 10511 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 55, Last known committed idx: 54, Time since last communication: 0.000s
I20260204 09:11:07.360627 10502 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:07.360724 10502 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 28 FOLLOWER]: Advancing to term 29
I20260204 09:11:07.361339 10502 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:07.361529 10502 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 29 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:07.361703 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 29 candidate_status { last_received { term: 28 index: 55 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:07.361747 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 29 candidate_status { last_received { term: 28 index: 55 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:07.361939 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:07.362032 10502 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260204 09:11:07.375275 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 29 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 28. Current term is 29. Ops: []
I20260204 09:11:07.375504 10513 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 28.55, Next index: 56, Last known committed idx: 55, Time since last communication: 0.000s
I20260204 09:11:07.375622 10513 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 28 LEADER]: Stepping down as leader of term 28
I20260204 09:11:07.375646 10513 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:07.375696 10513 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 55, Committed index: 55, Last appended: 28.55, Last appended by leader: 55, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:07.375773 10513 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 28 FOLLOWER]: Advancing to term 29
I20260204 09:11:07.449344 10512 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:07.449460 10512 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 28 FOLLOWER]: Advancing to term 29
I20260204 09:11:07.450112 10512 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:07.450292 10512 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 29 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:07.450490 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 29 candidate_status { last_received { term: 28 index: 55 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:07.450495 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 29 candidate_status { last_received { term: 28 index: 55 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:07.450649 10322 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 11502cf05241427fb9853e628add7746 in current term 29: Already voted for candidate bd38b0e96f264071a69be73b6b4f14c1 in this term.
I20260204 09:11:07.451143 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 29.
I20260204 09:11:07.451308 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:07.451390 10512 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 29 FOLLOWER]: Leader election won for term 29
I20260204 09:11:07.451435 10512 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 29 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:07.451483 10512 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 55, Committed index: 55, Last appended: 28.55, Last appended by leader: 55, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:07.451901 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 28 to 29, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 29 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:07.473526 10502 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:07.473611 10502 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 29 FOLLOWER]: Advancing to term 30
I20260204 09:11:07.474193 10502 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:07.474318 10502 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 30 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:07.474515 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 30 candidate_status { last_received { term: 28 index: 55 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:07.474578 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 29 FOLLOWER]: Advancing to term 30
I20260204 09:11:07.474538 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 30 candidate_status { last_received { term: 28 index: 55 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:07.475072 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 30.
I20260204 09:11:07.475226 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:07.475313 10502 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 30 FOLLOWER]: Leader election won for term 30
I20260204 09:11:07.475369 10502 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 30 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:07.475417 10502 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 55, Committed index: 55, Last appended: 28.55, Last appended by leader: 55, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:07.475812 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 29 to 30, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 30 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:07.542176 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 30 LEADER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 29. Current term is 30. Ops: []
I20260204 09:11:07.542451 10512 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 0.0, Next index: 56, Last known committed idx: 55, Time since last communication: 0.000s
I20260204 09:11:07.542562 10512 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer bd38b0e96f264071a69be73b6b4f14c1 log is divergent from this leader: its last log entry 30.56 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 55
I20260204 09:11:07.542598 10507 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 29 LEADER]: Stepping down as leader of term 29
I20260204 09:11:07.542634 10507 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:07.542681 10507 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 55, Committed index: 55, Last appended: 29.56, Last appended by leader: 56, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:07.542754 10507 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 29 FOLLOWER]: Advancing to term 30
I20260204 09:11:07.566080 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 30 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 28 index: 55. Preceding OpId from leader: term: 30 index: 56. (index mismatch)
I20260204 09:11:07.566327 10502 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 56, Last known committed idx: 55, Time since last communication: 0.000s
I20260204 09:11:07.567242 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 30 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 29 index: 56. Preceding OpId from leader: term: 30 index: 56. (term mismatch)
I20260204 09:11:07.567292 10246 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting all ops after (but not including) 55
I20260204 09:11:07.567309 10246 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting uncommitted NO_OP operation due to leader change: 29.56
I20260204 09:11:07.567324 10246 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 30 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:07.567472 10502 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 56, Last known committed idx: 55, Time since last communication: 0.000s
I20260204 09:11:07.748948 10513 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 30 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:07.749040 10513 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 30 FOLLOWER]: Advancing to term 31
I20260204 09:11:07.749759 10513 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:07.749928 10513 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 31 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:07.750133 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 31 candidate_status { last_received { term: 30 index: 56 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:07.750155 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 31 candidate_status { last_received { term: 30 index: 56 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:07.750356 10362 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:07.750453 10513 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260204 09:11:07.763723 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 31 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 30. Current term is 31. Ops: []
I20260204 09:11:07.763967 10514 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 30.56, Next index: 57, Last known committed idx: 56, Time since last communication: 0.000s
I20260204 09:11:07.764097 10502 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 30 LEADER]: Stepping down as leader of term 30
I20260204 09:11:07.764173 10502 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 30 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:07.764235 10502 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 56, Committed index: 56, Last appended: 30.56, Last appended by leader: 56, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:07.764326 10502 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 30 FOLLOWER]: Advancing to term 31
I20260204 09:11:07.774201 10507 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 30 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:07.774271 10507 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 30 FOLLOWER]: Advancing to term 31
I20260204 09:11:07.774830 10507 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:07.774960 10507 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 31 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:07.775141 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 31 candidate_status { last_received { term: 30 index: 56 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:07.775205 10397 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 11502cf05241427fb9853e628add7746 in current term 31: Already voted for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in this term.
I20260204 09:11:07.775156 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 31 candidate_status { last_received { term: 30 index: 56 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:07.775736 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 31.
I20260204 09:11:07.775893 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:07.775974 10507 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 31 FOLLOWER]: Leader election won for term 31
I20260204 09:11:07.776026 10507 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 31 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:07.776075 10507 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 56, Committed index: 56, Last appended: 30.56, Last appended by leader: 56, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:07.776475 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 30 to 31, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 31 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:07.852807 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 31 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 30 index: 56. Preceding OpId from leader: term: 31 index: 57. (index mismatch)
I20260204 09:11:07.853072 10507 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 57, Last known committed idx: 56, Time since last communication: 0.000s
I20260204 09:11:07.854068 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 31 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 30 index: 56. Preceding OpId from leader: term: 31 index: 57. (index mismatch)
I20260204 09:11:07.854279 10507 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 57, Last known committed idx: 56, Time since last communication: 0.000s
I20260204 09:11:07.955032 10509 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 31 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:07.955137 10509 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 31 FOLLOWER]: Advancing to term 32
I20260204 09:11:07.955789 10509 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:07.955956 10509 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 32 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:07.955978 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 32 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 31. Current term is 32. Ops: []
I20260204 09:11:07.956107 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 32 candidate_status { last_received { term: 31 index: 57 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:07.956115 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 32 candidate_status { last_received { term: 31 index: 57 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:07.956210 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 31 FOLLOWER]: Advancing to term 32
I20260204 09:11:07.956342 10512 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 31.57, Next index: 58, Last known committed idx: 57, Time since last communication: 0.000s
I20260204 09:11:07.956432 10512 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 31 LEADER]: Stepping down as leader of term 31
I20260204 09:11:07.956465 10512 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 31 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:07.956532 10512 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 57, Committed index: 57, Last appended: 31.57, Last appended by leader: 57, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:07.956595 10512 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 31 FOLLOWER]: Advancing to term 32
I20260204 09:11:07.956853 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 32.
I20260204 09:11:07.957015 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:07.957101 10509 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 32 FOLLOWER]: Leader election won for term 32
I20260204 09:11:07.957163 10509 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 32 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:07.957207 10509 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 57, Committed index: 57, Last appended: 31.57, Last appended by leader: 57, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:07.957590 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 31 to 32, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 32 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:07.976816 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:08.049089 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 32 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 31 index: 57. Preceding OpId from leader: term: 32 index: 58. (index mismatch)
I20260204 09:11:08.049384 10509 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 58, Last known committed idx: 57, Time since last communication: 0.000s
I20260204 09:11:08.050356 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 32 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 31 index: 57. Preceding OpId from leader: term: 32 index: 58. (index mismatch)
I20260204 09:11:08.050516 10513 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 58, Last known committed idx: 57, Time since last communication: 0.000s
I20260204 09:11:08.228726 10512 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 32 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:08.228825 10512 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 32 FOLLOWER]: Advancing to term 33
I20260204 09:11:08.229497 10512 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:08.229653 10512 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 33 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:08.229859 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 33 candidate_status { last_received { term: 32 index: 58 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:08.229859 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 33 candidate_status { last_received { term: 32 index: 58 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:08.230106 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11502cf05241427fb9853e628add7746; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:08.230201 10512 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
I20260204 09:11:08.247332 10502 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 32 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:08.247421 10502 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 32 FOLLOWER]: Advancing to term 33
I20260204 09:11:08.248008 10502 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:08.248144 10502 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 33 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:08.248368 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 33 candidate_status { last_received { term: 32 index: 58 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:08.248373 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 33 candidate_status { last_received { term: 32 index: 58 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:08.248494 10246 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate bd38b0e96f264071a69be73b6b4f14c1 in current term 33: Already voted for candidate 11502cf05241427fb9853e628add7746 in this term.
I20260204 09:11:08.248618 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:08.248715 10502 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
I20260204 09:11:08.252426 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 33 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 32. Current term is 33. Ops: []
I20260204 09:11:08.252628 10515 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 32.58, Next index: 59, Last known committed idx: 58, Time since last communication: 0.000s
I20260204 09:11:08.252746 10515 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 32 LEADER]: Stepping down as leader of term 32
I20260204 09:11:08.252784 10515 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 32 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:08.252837 10515 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 58, Committed index: 58, Last appended: 32.58, Last appended by leader: 58, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:08.252911 10515 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 32 FOLLOWER]: Advancing to term 33
I20260204 09:11:08.339818 10512 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:08.339919 10512 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 33 FOLLOWER]: Advancing to term 34
I20260204 09:11:08.341281 10512 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:08.341500 10512 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 34 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:08.341712 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 34 candidate_status { last_received { term: 32 index: 58 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:08.341712 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 34 candidate_status { last_received { term: 32 index: 58 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:08.341787 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 33 FOLLOWER]: Advancing to term 34
I20260204 09:11:08.341830 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 33 FOLLOWER]: Advancing to term 34
I20260204 09:11:08.342319 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 34.
I20260204 09:11:08.342415 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 34.
I20260204 09:11:08.342512 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters:
I20260204 09:11:08.342615 10512 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 34 FOLLOWER]: Leader election won for term 34
I20260204 09:11:08.342660 10512 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 34 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:08.342727 10512 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 58, Committed index: 58, Last appended: 32.58, Last appended by leader: 58, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:08.343119 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 32 to 34, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 34 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:08.426461 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 34 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 32 index: 58. Preceding OpId from leader: term: 34 index: 59. (index mismatch)
I20260204 09:11:08.426734 10512 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 59, Last known committed idx: 58, Time since last communication: 0.000s
I20260204 09:11:08.427762 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 34 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 32 index: 58. Preceding OpId from leader: term: 34 index: 59. (index mismatch)
I20260204 09:11:08.427898 10507 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 59, Last known committed idx: 58, Time since last communication: 0.000s
I20260204 09:11:08.611887 10509 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 34 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:08.612004 10509 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 34 FOLLOWER]: Advancing to term 35
I20260204 09:11:08.612694 10509 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 35 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:08.612875 10509 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 35 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:08.613075 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 35 candidate_status { last_received { term: 34 index: 59 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:08.613087 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 35 candidate_status { last_received { term: 34 index: 59 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:08.613338 10362 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 35 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:08.613449 10509 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 35 FOLLOWER]: Leader election lost for term 35. Reason: could not achieve majority
I20260204 09:11:08.632135 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 35 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 34. Current term is 35. Ops: []
I20260204 09:11:08.632400 10507 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 34.59, Next index: 60, Last known committed idx: 59, Time since last communication: 0.000s
I20260204 09:11:08.632531 10512 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 34 LEADER]: Stepping down as leader of term 34
I20260204 09:11:08.632572 10512 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 34 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:08.632627 10512 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 59, Committed index: 59, Last appended: 34.59, Last appended by leader: 59, Current term: 34, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:08.632704 10512 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 34 FOLLOWER]: Advancing to term 35
I20260204 09:11:08.695605 10502 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 34 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:08.695695 10502 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 34 FOLLOWER]: Advancing to term 35
I20260204 09:11:08.696291 10502 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 35 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:08.696429 10502 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 35 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:08.696652 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 35 candidate_status { last_received { term: 34 index: 59 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:08.696652 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 35 candidate_status { last_received { term: 34 index: 59 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:08.696779 10397 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 35 FOLLOWER]: Leader election vote request: Denying vote to candidate bd38b0e96f264071a69be73b6b4f14c1 in current term 35: Already voted for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in this term.
I20260204 09:11:08.697329 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 35.
I20260204 09:11:08.697522 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 35 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:08.697620 10502 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 35 FOLLOWER]: Leader election won for term 35
I20260204 09:11:08.697734 10502 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 35 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:08.697784 10502 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 59, Committed index: 59, Last appended: 34.59, Last appended by leader: 59, Current term: 35, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:08.698185 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 34 to 35, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 35 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:08.741865 10509 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 35 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:08.741962 10509 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 35 FOLLOWER]: Advancing to term 36
I20260204 09:11:08.742576 10509 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 36 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:08.742726 10509 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 36 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:08.742941 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 36 candidate_status { last_received { term: 34 index: 59 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:08.742938 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 36 candidate_status { last_received { term: 34 index: 59 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:08.743045 10246 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 35 FOLLOWER]: Advancing to term 36
I20260204 09:11:08.743647 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 36.
I20260204 09:11:08.743801 10362 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 36 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:08.743894 10509 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 36 FOLLOWER]: Leader election won for term 36
I20260204 09:11:08.743942 10509 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 36 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:08.743978 10509 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 59, Committed index: 59, Last appended: 34.59, Last appended by leader: 59, Current term: 36, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:08.744391 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 35 to 36, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 36 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:08.800642 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 36 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 35. Current term is 36. Ops: []
I20260204 09:11:08.800885 10502 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 60, Last known committed idx: 59, Time since last communication: 0.000s
I20260204 09:11:08.800985 10502 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 35 LEADER]: Stepping down as leader of term 35
I20260204 09:11:08.801017 10502 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 35 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:08.801067 10502 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 59, Committed index: 59, Last appended: 35.60, Last appended by leader: 60, Current term: 35, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:08.801136 10502 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 35 FOLLOWER]: Advancing to term 36
I20260204 09:11:08.836819 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 36 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 34 index: 59. Preceding OpId from leader: term: 36 index: 60. (index mismatch)
I20260204 09:11:08.837060 10509 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 60, Last known committed idx: 59, Time since last communication: 0.000s
I20260204 09:11:08.837985 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 36 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 35 index: 60. Preceding OpId from leader: term: 36 index: 60. (term mismatch)
I20260204 09:11:08.838035 10322 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Aborting all ops after (but not including) 59
I20260204 09:11:08.838052 10322 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Aborting uncommitted NO_OP operation due to leader change: 35.60
I20260204 09:11:08.838068 10322 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 36 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:08.838217 10509 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 60, Last known committed idx: 59, Time since last communication: 0.000s
I20260204 09:11:08.938776 10512 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 36 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:08.938871 10512 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 36 FOLLOWER]: Advancing to term 37
I20260204 09:11:08.939493 10512 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 37 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:08.939643 10512 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 37 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:08.939836 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 37 candidate_status { last_received { term: 36 index: 60 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:08.939874 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 37 candidate_status { last_received { term: 36 index: 60 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:08.939932 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 36 FOLLOWER]: Advancing to term 37
I20260204 09:11:08.940445 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 37 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 37.
I20260204 09:11:08.940609 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 37 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:08.940692 10512 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 37 FOLLOWER]: Leader election won for term 37
I20260204 09:11:08.940744 10512 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 37 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:08.940789 10512 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 60, Committed index: 60, Last appended: 36.60, Last appended by leader: 60, Current term: 37, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:08.941217 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 36 to 37, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 37 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:08.945861 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 37 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 36. Current term is 37. Ops: []
I20260204 09:11:08.946061 10518 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 36.60, Next index: 61, Last known committed idx: 60, Time since last communication: 0.000s
I20260204 09:11:08.946151 10518 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 36 LEADER]: Stepping down as leader of term 36
I20260204 09:11:08.946183 10518 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 36 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:08.946240 10518 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 60, Committed index: 60, Last appended: 36.60, Last appended by leader: 60, Current term: 36, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:08.946311 10518 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 36 FOLLOWER]: Advancing to term 37
I20260204 09:11:08.977069 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:09.049737 10502 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 37 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:09.049837 10502 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 37 FOLLOWER]: Advancing to term 38
I20260204 09:11:09.050442 10502 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 38 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:09.050583 10502 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 38 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:09.050814 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 38 candidate_status { last_received { term: 36 index: 60 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:09.050818 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 38 candidate_status { last_received { term: 36 index: 60 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:09.050956 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 37 FOLLOWER]: Advancing to term 38
I20260204 09:11:09.051488 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 38 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 38.
I20260204 09:11:09.051635 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 38 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:09.051724 10502 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 38 FOLLOWER]: Leader election won for term 38
I20260204 09:11:09.051777 10502 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 38 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:09.051826 10502 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 60, Committed index: 60, Last appended: 36.60, Last appended by leader: 60, Current term: 38, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:09.052245 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 37 to 38, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 38 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:09.053442 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 38 LEADER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 37. Current term is 38. Ops: []
I20260204 09:11:09.053645 10512 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 0.0, Next index: 61, Last known committed idx: 60, Time since last communication: 0.000s
I20260204 09:11:09.053735 10512 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer bd38b0e96f264071a69be73b6b4f14c1 log is divergent from this leader: its last log entry 38.61 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 60
I20260204 09:11:09.053776 10507 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 37 LEADER]: Stepping down as leader of term 37
I20260204 09:11:09.053817 10507 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 37 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:09.053861 10507 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 60, Committed index: 60, Last appended: 37.61, Last appended by leader: 61, Current term: 37, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:09.053918 10507 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 37 FOLLOWER]: Advancing to term 38
I20260204 09:11:09.170780 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 38 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 36 index: 60. Preceding OpId from leader: term: 38 index: 61. (index mismatch)
I20260204 09:11:09.171047 10502 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 61, Last known committed idx: 60, Time since last communication: 0.000s
I20260204 09:11:09.172098 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 38 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 37 index: 61. Preceding OpId from leader: term: 38 index: 61. (term mismatch)
I20260204 09:11:09.172155 10246 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting all ops after (but not including) 60
I20260204 09:11:09.172174 10246 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting uncommitted NO_OP operation due to leader change: 37.61
I20260204 09:11:09.172194 10246 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 38 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:09.172365 10502 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 61, Last known committed idx: 60, Time since last communication: 0.000s
I20260204 09:11:09.358505 10512 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 38 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:09.358590 10512 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 38 FOLLOWER]: Advancing to term 39
I20260204 09:11:09.359230 10512 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 39 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:09.359387 10512 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 39 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:09.359548 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 39 candidate_status { last_received { term: 38 index: 61 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:09.359550 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 39 candidate_status { last_received { term: 38 index: 61 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:09.359802 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 39 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11502cf05241427fb9853e628add7746; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:09.359892 10512 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 39 FOLLOWER]: Leader election lost for term 39. Reason: could not achieve majority
I20260204 09:11:09.362064 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 39 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 38. Current term is 39. Ops: []
I20260204 09:11:09.362295 10517 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 38.61, Next index: 62, Last known committed idx: 61, Time since last communication: 0.000s
I20260204 09:11:09.362414 10519 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 38 LEADER]: Stepping down as leader of term 38
I20260204 09:11:09.362459 10519 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 38 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:09.362524 10519 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 61, Committed index: 61, Last appended: 38.61, Last appended by leader: 61, Current term: 38, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:09.362607 10519 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 38 FOLLOWER]: Advancing to term 39
I20260204 09:11:09.457406 10518 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 38 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:09.457502 10518 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 38 FOLLOWER]: Advancing to term 39
I20260204 09:11:09.458159 10518 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 39 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:09.458324 10518 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 39 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:09.458524 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 39 candidate_status { last_received { term: 38 index: 61 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:09.458524 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 39 candidate_status { last_received { term: 38 index: 61 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:09.458652 10246 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 39 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in current term 39: Already voted for candidate 11502cf05241427fb9853e628add7746 in this term.
I20260204 09:11:09.459209 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 39 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 39.
I20260204 09:11:09.459375 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 39 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:09.459473 10518 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 39 FOLLOWER]: Leader election won for term 39
I20260204 09:11:09.459584 10518 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 39 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:09.459638 10518 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 61, Committed index: 61, Last appended: 38.61, Last appended by leader: 61, Current term: 39, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:09.460064 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 38 to 39, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 39 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:09.500274 10512 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 39 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:09.500370 10512 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 39 FOLLOWER]: Advancing to term 40
I20260204 09:11:09.500994 10512 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 40 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:09.501156 10512 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 40 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:09.501401 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 40 candidate_status { last_received { term: 38 index: 61 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:09.501396 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 40 candidate_status { last_received { term: 38 index: 61 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:09.501547 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 39 FOLLOWER]: Advancing to term 40
I20260204 09:11:09.502075 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 40 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 40.
I20260204 09:11:09.502241 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 40 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:09.502323 10512 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 40 FOLLOWER]: Leader election won for term 40
I20260204 09:11:09.502383 10512 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 40 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:09.502436 10512 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 61, Committed index: 61, Last appended: 38.61, Last appended by leader: 61, Current term: 40, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:09.502851 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 39 to 40, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 40 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:09.576459 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 40 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 39. Current term is 40. Ops: []
I20260204 09:11:09.576723 10518 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 0.0, Next index: 62, Last known committed idx: 61, Time since last communication: 0.000s
I20260204 09:11:09.576821 10518 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 39 LEADER]: Stepping down as leader of term 39
I20260204 09:11:09.576849 10518 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 39 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:09.576903 10518 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 61, Committed index: 61, Last appended: 39.62, Last appended by leader: 62, Current term: 39, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:09.576972 10518 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 39 FOLLOWER]: Advancing to term 40
I20260204 09:11:09.605311 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 40 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 38 index: 61. Preceding OpId from leader: term: 40 index: 62. (index mismatch)
I20260204 09:11:09.605620 10512 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 62, Last known committed idx: 61, Time since last communication: 0.000s
I20260204 09:11:09.605883 10519 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 40 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:09.605943 10519 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 40 FOLLOWER]: Advancing to term 41
I20260204 09:11:09.606539 10519 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 41 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:09.606662 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 41 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 40. Current term is 41. Ops: [40.62-40.62]
I20260204 09:11:09.606676 10519 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 41 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:09.606804 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 41 candidate_status { last_received { term: 38 index: 61 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:09.606880 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 40 FOLLOWER]: Advancing to term 41
I20260204 09:11:09.606882 10512 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 38.61, Next index: 62, Last known committed idx: 61, Time since last communication: 0.000s
I20260204 09:11:09.606882 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 41 candidate_status { last_received { term: 38 index: 61 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:09.607005 10512 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 40 LEADER]: Stepping down as leader of term 40
I20260204 09:11:09.607029 10512 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 40 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:09.607095 10512 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 61, Committed index: 61, Last appended: 40.62, Last appended by leader: 62, Current term: 40, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:09.607151 10512 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 40 FOLLOWER]: Advancing to term 41
I20260204 09:11:09.607470 10397 raft_consensus.cc:2410] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 41 FOLLOWER]: Leader election vote request: Denying vote to candidate bd38b0e96f264071a69be73b6b4f14c1 for term 41 because replica has last-logged OpId of term: 39 index: 62, which is greater than that of the candidate, which has last-logged OpId of term: 38 index: 61.
I20260204 09:11:09.607631 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 41 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:09.607717 10519 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 41 FOLLOWER]: Leader election lost for term 41. Reason: could not achieve majority
I20260204 09:11:09.752135 10519 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 41 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:09.752228 10519 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 41 FOLLOWER]: Advancing to term 42
I20260204 09:11:09.752876 10519 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 42 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:09.753026 10519 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 42 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:09.753233 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 42 candidate_status { last_received { term: 38 index: 61 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:09.753297 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 41 FOLLOWER]: Advancing to term 42
I20260204 09:11:09.753261 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 42 candidate_status { last_received { term: 38 index: 61 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:09.753381 10246 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 41 FOLLOWER]: Advancing to term 42
I20260204 09:11:09.753865 10397 raft_consensus.cc:2410] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 42 FOLLOWER]: Leader election vote request: Denying vote to candidate bd38b0e96f264071a69be73b6b4f14c1 for term 42 because replica has last-logged OpId of term: 39 index: 62, which is greater than that of the candidate, which has last-logged OpId of term: 38 index: 61.
I20260204 09:11:09.753994 10246 raft_consensus.cc:2410] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 42 FOLLOWER]: Leader election vote request: Denying vote to candidate bd38b0e96f264071a69be73b6b4f14c1 for term 42 because replica has last-logged OpId of term: 40 index: 62, which is greater than that of the candidate, which has last-logged OpId of term: 38 index: 61.
I20260204 09:11:09.754156 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 42 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:09.754240 10519 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 42 FOLLOWER]: Leader election lost for term 42. Reason: could not achieve majority
I20260204 09:11:09.802549 10518 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 42 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:09.802644 10518 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 42 FOLLOWER]: Advancing to term 43
I20260204 09:11:09.803277 10518 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 43 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:09.803449 10518 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 43 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:09.803647 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 43 candidate_status { last_received { term: 39 index: 62 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:09.803647 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 43 candidate_status { last_received { term: 39 index: 62 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:09.803797 10246 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 42 FOLLOWER]: Advancing to term 43
I20260204 09:11:09.803805 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 42 FOLLOWER]: Advancing to term 43
I20260204 09:11:09.804482 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 43 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 43.
I20260204 09:11:09.804495 10246 raft_consensus.cc:2410] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 43 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b12f9075d9d4ffa9fd711322da0c4d2 for term 43 because replica has last-logged OpId of term: 40 index: 62, which is greater than that of the candidate, which has last-logged OpId of term: 39 index: 62.
I20260204 09:11:09.804693 10362 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 43 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:09.804800 10518 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 43 FOLLOWER]: Leader election won for term 43
I20260204 09:11:09.804872 10518 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 43 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:09.804927 10518 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 61, Committed index: 61, Last appended: 39.62, Last appended by leader: 62, Current term: 43, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:09.805408 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 40 to 43, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 43 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:09.893872 10512 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 43 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:09.893960 10512 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 43 FOLLOWER]: Advancing to term 44
I20260204 09:11:09.894546 10512 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 44 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:09.894690 10512 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 44 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:09.894917 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 44 candidate_status { last_received { term: 40 index: 62 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:09.894990 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 43 FOLLOWER]: Advancing to term 44
I20260204 09:11:09.894928 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 44 candidate_status { last_received { term: 40 index: 62 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:09.895519 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 44 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 44.
I20260204 09:11:09.895676 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 44 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:09.895763 10512 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 44 FOLLOWER]: Leader election won for term 44
I20260204 09:11:09.895833 10512 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 44 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:09.895888 10512 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 61, Committed index: 61, Last appended: 40.62, Last appended by leader: 62, Current term: 44, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:09.896318 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 43 to 44, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 44 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:09.898417 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 44 LEADER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 43. Current term is 44. Ops: []
I20260204 09:11:09.898597 10518 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 63, Last known committed idx: 61, Time since last communication: 0.000s
I20260204 09:11:09.898676 10518 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer 11502cf05241427fb9853e628add7746 log is divergent from this leader: its last log entry 44.63 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 61
I20260204 09:11:09.898713 10520 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 43 LEADER]: Stepping down as leader of term 43
I20260204 09:11:09.898759 10520 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 43 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:09.898820 10520 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 61, Committed index: 61, Last appended: 43.63, Last appended by leader: 63, Current term: 43, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:09.898892 10520 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 43 FOLLOWER]: Advancing to term 44
I20260204 09:11:09.972669 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 44 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 38 index: 61. Preceding OpId from leader: term: 44 index: 63. (index mismatch)
I20260204 09:11:09.972913 10512 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 63, Last known committed idx: 61, Time since last communication: 0.000s
I20260204 09:11:09.973805 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 44 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 43 index: 63. Preceding OpId from leader: term: 44 index: 63. (term mismatch)
I20260204 09:11:09.973866 10397 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2: Aborting all ops after (but not including) 62
I20260204 09:11:09.973886 10397 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2: Aborting uncommitted NO_OP operation due to leader change: 43.63
I20260204 09:11:09.973902 10397 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 44 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:09.974081 10521 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 63, Last known committed idx: 61, Time since last communication: 0.000s
I20260204 09:11:09.974161 10521 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer 8b12f9075d9d4ffa9fd711322da0c4d2 log is divergent from this leader: its last log entry 39.62 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 61
I20260204 09:11:09.974426 10397 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2: Aborting all ops after (but not including) 61
I20260204 09:11:09.974469 10397 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2: Aborting uncommitted NO_OP operation due to leader change: 39.62
I20260204 09:11:09.974488 10397 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 44 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:09.977294 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:10.331696 10523 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 44 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:10.331799 10523 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 44 FOLLOWER]: Advancing to term 45
I20260204 09:11:10.332535 10523 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 45 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:10.332698 10523 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 45 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:10.332914 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 45 candidate_status { last_received { term: 44 index: 63 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:10.332911 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 45 candidate_status { last_received { term: 44 index: 63 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:10.333175 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 45 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:10.333267 10523 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 45 FOLLOWER]: Leader election lost for term 45. Reason: could not achieve majority
I20260204 09:11:10.355227 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 45 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 44. Current term is 45. Ops: []
I20260204 09:11:10.355449 10507 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 44.63, Next index: 64, Last known committed idx: 63, Time since last communication: 0.000s
I20260204 09:11:10.355556 10507 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 44 LEADER]: Stepping down as leader of term 44
I20260204 09:11:10.355589 10507 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 44 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:10.355648 10507 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 63, Committed index: 63, Last appended: 44.63, Last appended by leader: 63, Current term: 44, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:10.355723 10507 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 44 FOLLOWER]: Advancing to term 45
I20260204 09:11:10.455911 10522 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 44 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:10.456007 10522 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 44 FOLLOWER]: Advancing to term 45
I20260204 09:11:10.456745 10522 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 45 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:10.456905 10522 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 45 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:10.457139 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 45 candidate_status { last_received { term: 44 index: 63 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:10.457158 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 45 candidate_status { last_received { term: 44 index: 63 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:10.457238 10397 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 45 FOLLOWER]: Leader election vote request: Denying vote to candidate bd38b0e96f264071a69be73b6b4f14c1 in current term 45: Already voted for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in this term.
I20260204 09:11:10.457819 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 45 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 45.
I20260204 09:11:10.457994 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 45 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:10.458092 10522 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 45 FOLLOWER]: Leader election won for term 45
I20260204 09:11:10.458141 10522 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 45 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:10.458191 10522 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 63, Committed index: 63, Last appended: 44.63, Last appended by leader: 63, Current term: 45, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:10.458602 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 44 to 45, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 45 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:10.465639 10523 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 45 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:10.465687 10523 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 45 FOLLOWER]: Advancing to term 46
I20260204 09:11:10.466180 10523 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 46 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:10.466288 10523 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 46 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:10.466432 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 46 candidate_status { last_received { term: 44 index: 63 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:10.466463 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 46 candidate_status { last_received { term: 44 index: 63 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:10.466492 10246 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 45 FOLLOWER]: Advancing to term 46
I20260204 09:11:10.467036 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 46 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 46.
I20260204 09:11:10.467197 10362 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 46 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:10.467278 10523 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 46 FOLLOWER]: Leader election won for term 46
I20260204 09:11:10.467324 10523 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 46 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:10.467367 10523 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 63, Committed index: 63, Last appended: 44.63, Last appended by leader: 63, Current term: 46, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:10.467746 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 45 to 46, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 46 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:10.554044 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 46 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 45. Current term is 46. Ops: []
I20260204 09:11:10.554315 10522 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 64, Last known committed idx: 63, Time since last communication: 0.000s
I20260204 09:11:10.554445 10522 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 45 LEADER]: Stepping down as leader of term 45
I20260204 09:11:10.554464 10522 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 45 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:10.554509 10522 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 63, Committed index: 63, Last appended: 45.64, Last appended by leader: 64, Current term: 45, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:10.554581 10522 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 45 FOLLOWER]: Advancing to term 46
I20260204 09:11:10.559077 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 46 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 44 index: 63. Preceding OpId from leader: term: 46 index: 64. (index mismatch)
I20260204 09:11:10.559298 10523 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 64, Last known committed idx: 63, Time since last communication: 0.000s
I20260204 09:11:10.560184 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 46 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 45 index: 64. Preceding OpId from leader: term: 46 index: 64. (term mismatch)
I20260204 09:11:10.560235 10322 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Aborting all ops after (but not including) 63
I20260204 09:11:10.560252 10322 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Aborting uncommitted NO_OP operation due to leader change: 45.64
I20260204 09:11:10.560268 10322 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 46 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:10.560434 10523 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 64, Last known committed idx: 63, Time since last communication: 0.000s
I20260204 09:11:10.660781 10507 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 46 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:10.660878 10507 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 46 FOLLOWER]: Advancing to term 47
I20260204 09:11:10.661528 10507 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 47 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:10.661674 10507 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 47 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:10.661871 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 47 candidate_status { last_received { term: 46 index: 64 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:10.661895 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 47 candidate_status { last_received { term: 46 index: 64 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:10.661985 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 46 FOLLOWER]: Advancing to term 47
I20260204 09:11:10.662513 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 47 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 47.
I20260204 09:11:10.662714 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 47 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:10.662811 10507 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 47 FOLLOWER]: Leader election won for term 47
I20260204 09:11:10.662885 10507 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 47 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:10.662946 10507 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 64, Committed index: 64, Last appended: 46.64, Last appended by leader: 64, Current term: 47, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:10.663410 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 46 to 47, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 47 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:10.667568 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 47 LEADER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 46. Current term is 47. Ops: []
I20260204 09:11:10.667794 10523 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 46.64, Next index: 65, Last known committed idx: 64, Time since last communication: 0.000s
I20260204 09:11:10.667877 10523 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer 11502cf05241427fb9853e628add7746 log is divergent from this leader: its last log entry 47.65 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 64
I20260204 09:11:10.667904 10520 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 46 LEADER]: Stepping down as leader of term 46
I20260204 09:11:10.667943 10520 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 46 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:10.667992 10520 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 64, Committed index: 64, Last appended: 46.64, Last appended by leader: 64, Current term: 46, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:10.668048 10520 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 46 FOLLOWER]: Advancing to term 47
I20260204 09:11:10.758782 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 47 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 46 index: 64. Preceding OpId from leader: term: 47 index: 65. (index mismatch)
I20260204 09:11:10.759066 10507 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 65, Last known committed idx: 64, Time since last communication: 0.000s
I20260204 09:11:10.760144 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 47 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 46 index: 64. Preceding OpId from leader: term: 47 index: 65. (index mismatch)
I20260204 09:11:10.760313 10527 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 65, Last known committed idx: 64, Time since last communication: 0.000s
I20260204 09:11:10.969556 10520 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 47 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:10.969658 10520 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 47 FOLLOWER]: Advancing to term 48
I20260204 09:11:10.970530 10520 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 48 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:10.970707 10520 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 48 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:10.970901 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 48 candidate_status { last_received { term: 47 index: 65 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:10.970913 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 48 candidate_status { last_received { term: 47 index: 65 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:10.971180 10362 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 48 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:10.971278 10520 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 48 FOLLOWER]: Leader election lost for term 48. Reason: could not achieve majority
I20260204 09:11:10.977510 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:10.987358 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 48 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 47. Current term is 48. Ops: []
I20260204 09:11:10.987639 10507 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 47.65, Next index: 66, Last known committed idx: 65, Time since last communication: 0.000s
I20260204 09:11:10.987762 10507 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 47 LEADER]: Stepping down as leader of term 47
I20260204 09:11:10.987797 10507 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 47 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:10.987856 10507 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 65, Committed index: 65, Last appended: 47.65, Last appended by leader: 65, Current term: 47, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:10.987927 10507 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 47 FOLLOWER]: Advancing to term 48
I20260204 09:11:11.038399 10519 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 47 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:11.038499 10519 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 47 FOLLOWER]: Advancing to term 48
I20260204 09:11:11.039234 10519 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 48 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:11.039407 10519 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 48 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:11.039623 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 48 candidate_status { last_received { term: 47 index: 65 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:11.039623 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 48 candidate_status { last_received { term: 47 index: 65 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:11.039798 10397 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 48 FOLLOWER]: Leader election vote request: Denying vote to candidate bd38b0e96f264071a69be73b6b4f14c1 in current term 48: Already voted for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in this term.
I20260204 09:11:11.040319 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 48 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 48.
I20260204 09:11:11.040493 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 48 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:11.040584 10519 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 48 FOLLOWER]: Leader election won for term 48
I20260204 09:11:11.040644 10519 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 48 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:11.040686 10519 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 65, Committed index: 65, Last appended: 47.65, Last appended by leader: 65, Current term: 48, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:11.041131 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 47 to 48, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 48 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:11.074649 10520 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 48 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:11.074747 10520 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 48 FOLLOWER]: Advancing to term 49
I20260204 09:11:11.075398 10520 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 49 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:11.075557 10520 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 49 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:11.075752 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 49 candidate_status { last_received { term: 47 index: 65 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:11.075774 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 49 candidate_status { last_received { term: 47 index: 65 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:11.075855 10246 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 48 FOLLOWER]: Advancing to term 49
I20260204 09:11:11.076393 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 49 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 49.
I20260204 09:11:11.076535 10362 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 49 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:11.076618 10520 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 49 FOLLOWER]: Leader election won for term 49
I20260204 09:11:11.076663 10520 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 49 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:11.076710 10520 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 65, Committed index: 65, Last appended: 47.65, Last appended by leader: 65, Current term: 49, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:11.077121 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 48 to 49, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 49 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:11.143479 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 49 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 48. Current term is 49. Ops: []
I20260204 09:11:11.143744 10519 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 66, Last known committed idx: 65, Time since last communication: 0.000s
I20260204 09:11:11.143851 10519 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 48 LEADER]: Stepping down as leader of term 48
I20260204 09:11:11.143880 10519 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 48 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:11.143944 10519 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 65, Committed index: 65, Last appended: 48.66, Last appended by leader: 66, Current term: 48, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:11.144026 10519 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 48 FOLLOWER]: Advancing to term 49
I20260204 09:11:11.159413 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 49 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 48 index: 66. Preceding OpId from leader: term: 49 index: 66. (term mismatch)
I20260204 09:11:11.159475 10322 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Aborting all ops after (but not including) 65
I20260204 09:11:11.159489 10322 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Aborting uncommitted NO_OP operation due to leader change: 48.66
I20260204 09:11:11.159502 10322 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 49 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:11.159688 10520 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 66, Last known committed idx: 65, Time since last communication: 0.000s
I20260204 09:11:11.160486 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 49 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 47 index: 65. Preceding OpId from leader: term: 49 index: 66. (index mismatch)
I20260204 09:11:11.160682 10523 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 66, Last known committed idx: 65, Time since last communication: 0.000s
I20260204 09:11:11.261282 10507 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 49 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:11.261395 10507 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 49 FOLLOWER]: Advancing to term 50
I20260204 09:11:11.261984 10507 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 50 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:11.262147 10507 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 50 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:11.262368 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 50 candidate_status { last_received { term: 49 index: 66 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:11.262368 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 50 candidate_status { last_received { term: 49 index: 66 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:11.262513 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 49 FOLLOWER]: Advancing to term 50
I20260204 09:11:11.263041 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 50 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 50.
I20260204 09:11:11.263206 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 50 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:11.263338 10507 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 50 FOLLOWER]: Leader election won for term 50
I20260204 09:11:11.263397 10507 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 50 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:11.263468 10507 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 66, Committed index: 66, Last appended: 49.66, Last appended by leader: 66, Current term: 50, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:11.263847 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 49 to 50, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 50 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:11.281713 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 50 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 49. Current term is 50. Ops: []
I20260204 09:11:11.281893 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 50 LEADER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 49. Current term is 50. Ops: []
I20260204 09:11:11.281956 10528 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 49.66, Next index: 67, Last known committed idx: 66, Time since last communication: 0.000s
I20260204 09:11:11.282066 10528 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 49 LEADER]: Stepping down as leader of term 49
I20260204 09:11:11.282100 10528 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 49 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:11.282124 10523 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 49.66, Next index: 67, Last known committed idx: 66, Time since last communication: 0.000s
I20260204 09:11:11.282228 10523 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer 11502cf05241427fb9853e628add7746 log is divergent from this leader: its last log entry 50.67 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 66
I20260204 09:11:11.282317 10528 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 66, Committed index: 66, Last appended: 49.66, Last appended by leader: 66, Current term: 49, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:11.282398 10528 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 49 FOLLOWER]: Advancing to term 50
I20260204 09:11:11.347421 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 50 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 49 index: 66. Preceding OpId from leader: term: 50 index: 67. (index mismatch)
I20260204 09:11:11.347700 10507 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 67, Last known committed idx: 66, Time since last communication: 0.000s
I20260204 09:11:11.348768 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 50 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 49 index: 66. Preceding OpId from leader: term: 50 index: 67. (index mismatch)
I20260204 09:11:11.349057 10512 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 67, Last known committed idx: 66, Time since last communication: 0.000s
I20260204 09:11:11.450266 10519 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 50 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:11.450357 10519 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 50 FOLLOWER]: Advancing to term 51
I20260204 09:11:11.450984 10519 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 51 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:11.451148 10519 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 51 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:11.451377 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 51 candidate_status { last_received { term: 50 index: 67 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:11.451377 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 51 candidate_status { last_received { term: 50 index: 67 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:11.451623 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 51 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:11.451722 10519 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 51 FOLLOWER]: Leader election lost for term 51. Reason: could not achieve majority
I20260204 09:11:11.473032 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 51 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 50. Current term is 51. Ops: []
I20260204 09:11:11.473281 10507 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 50.67, Next index: 68, Last known committed idx: 67, Time since last communication: 0.000s
I20260204 09:11:11.473409 10507 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 50 LEADER]: Stepping down as leader of term 50
I20260204 09:11:11.473443 10507 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 50 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:11.473497 10507 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 67, Committed index: 67, Last appended: 50.67, Last appended by leader: 67, Current term: 50, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:11.473573 10507 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 50 FOLLOWER]: Advancing to term 51
I20260204 09:11:11.542554 10528 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 50 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:11.542655 10528 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 50 FOLLOWER]: Advancing to term 51
I20260204 09:11:11.543340 10528 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 51 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:11.543504 10528 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 51 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:11.543718 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 51 candidate_status { last_received { term: 50 index: 67 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:11.543744 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 51 candidate_status { last_received { term: 50 index: 67 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:11.543789 10322 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 51 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in current term 51: Already voted for candidate bd38b0e96f264071a69be73b6b4f14c1 in this term.
I20260204 09:11:11.544387 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 51 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 51.
I20260204 09:11:11.544523 10362 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 51 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:11.544605 10528 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 51 FOLLOWER]: Leader election won for term 51
I20260204 09:11:11.544656 10528 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 51 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:11.544705 10528 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 67, Committed index: 67, Last appended: 50.67, Last appended by leader: 67, Current term: 51, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:11.545114 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 50 to 51, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 51 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:11.560117 10519 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 51 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:11.560196 10519 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 51 FOLLOWER]: Advancing to term 52
I20260204 09:11:11.560779 10519 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 52 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:11.560925 10519 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 52 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:11.561126 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 52 candidate_status { last_received { term: 50 index: 67 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:11.561160 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 52 candidate_status { last_received { term: 50 index: 67 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:11.561245 10246 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 51 FOLLOWER]: Advancing to term 52
I20260204 09:11:11.561793 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 52 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 52.
I20260204 09:11:11.561932 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 52 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:11.562016 10519 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 52 FOLLOWER]: Leader election won for term 52
I20260204 09:11:11.562072 10519 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 52 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:11.562124 10519 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 67, Committed index: 67, Last appended: 50.67, Last appended by leader: 67, Current term: 52, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:11.562551 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 51 to 52, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 52 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:11.629566 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 52 LEADER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 51. Current term is 52. Ops: []
I20260204 09:11:11.629805 10528 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 0.0, Next index: 68, Last known committed idx: 67, Time since last communication: 0.000s
I20260204 09:11:11.629917 10528 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer bd38b0e96f264071a69be73b6b4f14c1 log is divergent from this leader: its last log entry 52.68 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 67
I20260204 09:11:11.629947 10523 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 51 LEADER]: Stepping down as leader of term 51
I20260204 09:11:11.629989 10523 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 51 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:11.630051 10523 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 67, Committed index: 67, Last appended: 51.68, Last appended by leader: 68, Current term: 51, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:11.630129 10523 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 51 FOLLOWER]: Advancing to term 52
I20260204 09:11:11.638912 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 52 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 50 index: 67. Preceding OpId from leader: term: 52 index: 68. (index mismatch)
I20260204 09:11:11.639154 10519 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 68, Last known committed idx: 67, Time since last communication: 0.000s
I20260204 09:11:11.640040 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 52 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 51 index: 68. Preceding OpId from leader: term: 52 index: 68. (term mismatch)
I20260204 09:11:11.640100 10397 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2: Aborting all ops after (but not including) 67
I20260204 09:11:11.640115 10397 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2: Aborting uncommitted NO_OP operation due to leader change: 51.68
I20260204 09:11:11.640131 10397 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 52 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:11.640268 10529 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 68, Last known committed idx: 67, Time since last communication: 0.000s
I20260204 09:11:11.840425 10507 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 52 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:11.840519 10507 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 52 FOLLOWER]: Advancing to term 53
I20260204 09:11:11.841177 10507 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 53 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:11.841339 10507 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 53 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:11.841566 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 53 candidate_status { last_received { term: 52 index: 68 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:11.841570 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 53 candidate_status { last_received { term: 52 index: 68 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:11.841686 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 52 FOLLOWER]: Advancing to term 53
I20260204 09:11:11.842231 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 53 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 53.
I20260204 09:11:11.842432 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 53 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:11.842519 10507 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 53 FOLLOWER]: Leader election won for term 53
I20260204 09:11:11.842589 10507 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 53 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:11.842643 10507 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 68, Committed index: 68, Last appended: 52.68, Last appended by leader: 68, Current term: 53, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:11.843037 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 52 to 53, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 53 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:11.844353 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 53 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 52. Current term is 53. Ops: []
I20260204 09:11:11.844576 10522 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 52.68, Next index: 69, Last known committed idx: 68, Time since last communication: 0.000s
I20260204 09:11:11.844659 10522 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 52 LEADER]: Stepping down as leader of term 52
I20260204 09:11:11.844686 10522 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 52 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:11.844730 10522 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 68, Committed index: 68, Last appended: 52.68, Last appended by leader: 68, Current term: 52, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:11.844800 10522 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 52 FOLLOWER]: Advancing to term 53
I20260204 09:11:11.932428 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 53 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 52 index: 68. Preceding OpId from leader: term: 53 index: 69. (index mismatch)
I20260204 09:11:11.932705 10507 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 69, Last known committed idx: 68, Time since last communication: 0.000s
I20260204 09:11:11.933741 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 53 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 52 index: 68. Preceding OpId from leader: term: 53 index: 69. (index mismatch)
I20260204 09:11:11.933913 10507 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 69, Last known committed idx: 68, Time since last communication: 0.000s
I20260204 09:11:11.977769 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:12.034160 10523 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 53 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:12.034242 10523 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 53 FOLLOWER]: Advancing to term 54
I20260204 09:11:12.034901 10523 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 54 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:12.035045 10523 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 54 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:12.035224 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 54 candidate_status { last_received { term: 53 index: 69 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:12.035233 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 54 candidate_status { last_received { term: 53 index: 69 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:12.035440 10362 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 54 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:12.035526 10523 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 54 FOLLOWER]: Leader election lost for term 54. Reason: could not achieve majority
I20260204 09:11:12.052023 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 54 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 53. Current term is 54. Ops: []
I20260204 09:11:12.052287 10527 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 53.69, Next index: 70, Last known committed idx: 69, Time since last communication: 0.000s
I20260204 09:11:12.052402 10527 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 53 LEADER]: Stepping down as leader of term 53
I20260204 09:11:12.052433 10527 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 53 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:12.052502 10527 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 69, Committed index: 69, Last appended: 53.69, Last appended by leader: 69, Current term: 53, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:12.052579 10527 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 53 FOLLOWER]: Advancing to term 54
I20260204 09:11:12.129820 10522 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 53 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:12.129913 10522 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 53 FOLLOWER]: Advancing to term 54
I20260204 09:11:12.130548 10522 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 54 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:12.130697 10522 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 54 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:12.130939 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 54 candidate_status { last_received { term: 53 index: 69 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:12.130939 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 54 candidate_status { last_received { term: 53 index: 69 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:12.131070 10397 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 54 FOLLOWER]: Leader election vote request: Denying vote to candidate bd38b0e96f264071a69be73b6b4f14c1 in current term 54: Already voted for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in this term.
I20260204 09:11:12.131613 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 54 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 54.
I20260204 09:11:12.131781 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 54 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:12.131877 10522 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 54 FOLLOWER]: Leader election won for term 54
I20260204 09:11:12.131933 10522 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 54 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:12.131989 10522 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 69, Committed index: 69, Last appended: 53.69, Last appended by leader: 69, Current term: 54, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:12.132416 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 53 to 54, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 54 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:12.154850 10523 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 54 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:12.154934 10523 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 54 FOLLOWER]: Advancing to term 55
I20260204 09:11:12.155539 10523 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 55 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:12.155694 10523 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 55 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:12.155921 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 55 candidate_status { last_received { term: 53 index: 69 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:12.155923 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 55 candidate_status { last_received { term: 53 index: 69 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:12.156078 10246 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 54 FOLLOWER]: Advancing to term 55
I20260204 09:11:12.156633 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 55 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 55.
I20260204 09:11:12.156808 10362 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 55 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:12.156939 10523 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 55 FOLLOWER]: Leader election won for term 55
I20260204 09:11:12.157039 10523 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 55 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:12.157094 10523 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 69, Committed index: 69, Last appended: 53.69, Last appended by leader: 69, Current term: 55, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:12.157539 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 54 to 55, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 55 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:12.232801 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 55 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 53 index: 69. Preceding OpId from leader: term: 55 index: 70. (index mismatch)
I20260204 09:11:12.233094 10523 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 70, Last known committed idx: 69, Time since last communication: 0.000s
I20260204 09:11:12.234082 10322 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 54 LEADER]: Stepping down as leader of term 54
I20260204 09:11:12.234143 10322 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 54 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:12.234200 10322 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 69, Committed index: 69, Last appended: 54.70, Last appended by leader: 70, Current term: 54, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:12.234289 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 54 FOLLOWER]: Advancing to term 55
I20260204 09:11:12.235008 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 55 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 54 index: 70. Preceding OpId from leader: term: 55 index: 70. (term mismatch)
I20260204 09:11:12.235050 10322 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Aborting all ops after (but not including) 69
I20260204 09:11:12.235064 10322 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Aborting uncommitted NO_OP operation due to leader change: 54.70
I20260204 09:11:12.235078 10322 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 55 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:12.235280 10531 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 70, Last known committed idx: 69, Time since last communication: 0.000s
I20260204 09:11:12.517897 10522 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 55 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:12.517978 10522 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 55 FOLLOWER]: Advancing to term 56
I20260204 09:11:12.518592 10522 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 56 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:12.518724 10522 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 56 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:12.518903 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 56 candidate_status { last_received { term: 55 index: 70 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:12.518906 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 56 candidate_status { last_received { term: 55 index: 70 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:12.519155 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 56 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:12.519238 10522 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 56 FOLLOWER]: Leader election lost for term 56. Reason: could not achieve majority
I20260204 09:11:12.538513 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 56 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 55. Current term is 56. Ops: []
I20260204 09:11:12.538765 10530 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 55.70, Next index: 71, Last known committed idx: 70, Time since last communication: 0.000s
I20260204 09:11:12.538908 10523 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 55 LEADER]: Stepping down as leader of term 55
I20260204 09:11:12.538962 10523 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 55 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:12.539018 10523 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 70, Committed index: 70, Last appended: 55.70, Last appended by leader: 70, Current term: 55, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:12.539109 10523 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 55 FOLLOWER]: Advancing to term 56
I20260204 09:11:12.617388 10527 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 55 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:12.617483 10527 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 55 FOLLOWER]: Advancing to term 56
I20260204 09:11:12.618144 10527 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 56 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:12.618307 10527 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 56 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:12.618521 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 56 candidate_status { last_received { term: 55 index: 70 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:12.618536 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 56 candidate_status { last_received { term: 55 index: 70 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:12.618614 10322 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 56 FOLLOWER]: Leader election vote request: Denying vote to candidate 11502cf05241427fb9853e628add7746 in current term 56: Already voted for candidate bd38b0e96f264071a69be73b6b4f14c1 in this term.
I20260204 09:11:12.619127 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 56 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 56.
I20260204 09:11:12.619273 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 56 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:12.619365 10527 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 56 FOLLOWER]: Leader election won for term 56
I20260204 09:11:12.619472 10527 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 56 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:12.619517 10527 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 70, Committed index: 70, Last appended: 55.70, Last appended by leader: 70, Current term: 56, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:12.619930 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 55 to 56, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 56 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:12.644982 10522 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 56 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:12.645062 10522 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 56 FOLLOWER]: Advancing to term 57
I20260204 09:11:12.645705 10522 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 57 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:12.645835 10522 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 57 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:12.646049 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 57 candidate_status { last_received { term: 55 index: 70 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:12.646034 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 57 candidate_status { last_received { term: 55 index: 70 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:12.646148 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 56 FOLLOWER]: Advancing to term 57
I20260204 09:11:12.646667 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 57 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 57.
I20260204 09:11:12.646834 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 57 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:12.646922 10522 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 57 FOLLOWER]: Leader election won for term 57
I20260204 09:11:12.647043 10522 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 57 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:12.647094 10522 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 70, Committed index: 70, Last appended: 55.70, Last appended by leader: 70, Current term: 57, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:12.647497 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 56 to 57, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 57 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:12.696245 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 57 LEADER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 56. Current term is 57. Ops: []
I20260204 09:11:12.696488 10527 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 0.0, Next index: 71, Last known committed idx: 70, Time since last communication: 0.000s
I20260204 09:11:12.696596 10527 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer bd38b0e96f264071a69be73b6b4f14c1 log is divergent from this leader: its last log entry 57.71 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 70
I20260204 09:11:12.696632 10532 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 56 LEADER]: Stepping down as leader of term 56
I20260204 09:11:12.696684 10532 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 56 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:12.696758 10532 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 70, Committed index: 70, Last appended: 56.71, Last appended by leader: 71, Current term: 56, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:12.696846 10532 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 56 FOLLOWER]: Advancing to term 57
I20260204 09:11:12.747961 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 57 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 56 index: 71. Preceding OpId from leader: term: 57 index: 71. (term mismatch)
I20260204 09:11:12.748036 10246 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting all ops after (but not including) 70
I20260204 09:11:12.748054 10246 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting uncommitted NO_OP operation due to leader change: 56.71
I20260204 09:11:12.748070 10246 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 57 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:12.748270 10522 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 71, Last known committed idx: 70, Time since last communication: 0.000s
I20260204 09:11:12.749256 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 57 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 55 index: 70. Preceding OpId from leader: term: 57 index: 71. (index mismatch)
I20260204 09:11:12.749460 10522 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 71, Last known committed idx: 70, Time since last communication: 0.000s
I20260204 09:11:12.936003 10523 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 57 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:12.936100 10523 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 57 FOLLOWER]: Advancing to term 58
I20260204 09:11:12.936703 10523 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 58 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:12.937000 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 58 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 57. Current term is 58. Ops: []
I20260204 09:11:12.937091 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 58 candidate_status { last_received { term: 57 index: 71 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:12.937083 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 58 candidate_status { last_received { term: 57 index: 71 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:12.937258 10534 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 57.71, Next index: 72, Last known committed idx: 71, Time since last communication: 0.000s
I20260204 09:11:12.937023 10523 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 58 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:12.937299 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 58 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:12.937388 10522 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 57 LEADER]: Stepping down as leader of term 57
I20260204 09:11:12.937412 10523 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 58 FOLLOWER]: Leader election lost for term 58. Reason: could not achieve majority
I20260204 09:11:12.937422 10522 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 57 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:12.937520 10522 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 71, Committed index: 71, Last appended: 57.71, Last appended by leader: 71, Current term: 57, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:12.937597 10522 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 57 FOLLOWER]: Advancing to term 58
I20260204 09:11:12.978009 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:13.019519 10532 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 57 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:13.019616 10532 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 57 FOLLOWER]: Advancing to term 58
I20260204 09:11:13.020251 10532 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 58 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:13.020408 10532 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 58 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:13.020601 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 58 candidate_status { last_received { term: 57 index: 71 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:13.020607 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 58 candidate_status { last_received { term: 57 index: 71 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:13.020740 10397 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 58 FOLLOWER]: Leader election vote request: Denying vote to candidate 11502cf05241427fb9853e628add7746 in current term 58: Already voted for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in this term.
I20260204 09:11:13.021185 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 58 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 58.
I20260204 09:11:13.021346 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 58 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:13.021445 10532 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 58 FOLLOWER]: Leader election won for term 58
I20260204 09:11:13.021494 10532 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 58 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:13.021529 10532 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 71, Committed index: 71, Last appended: 57.71, Last appended by leader: 71, Current term: 58, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:13.021948 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 57 to 58, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 58 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:13.065738 10523 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 58 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:13.065838 10523 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 58 FOLLOWER]: Advancing to term 59
I20260204 09:11:13.066437 10523 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 59 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:13.066610 10523 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 59 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:13.066794 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 59 candidate_status { last_received { term: 57 index: 71 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:13.066798 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 59 candidate_status { last_received { term: 57 index: 71 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:13.066921 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 58 FOLLOWER]: Advancing to term 59
I20260204 09:11:13.067425 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 59 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 59.
I20260204 09:11:13.067579 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 59 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:13.067669 10523 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 59 FOLLOWER]: Leader election won for term 59
I20260204 09:11:13.067785 10523 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 59 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:13.067828 10523 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 71, Committed index: 71, Last appended: 57.71, Last appended by leader: 71, Current term: 59, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:13.068255 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 58 to 59, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 59 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:13.101248 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 59 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 58. Current term is 59. Ops: []
I20260204 09:11:13.101504 10532 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 0.0, Next index: 72, Last known committed idx: 71, Time since last communication: 0.000s
I20260204 09:11:13.101622 10532 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 58 LEADER]: Stepping down as leader of term 58
I20260204 09:11:13.101653 10532 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 58 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:13.101709 10532 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 71, Committed index: 71, Last appended: 58.72, Last appended by leader: 72, Current term: 58, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:13.101779 10532 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 58 FOLLOWER]: Advancing to term 59
I20260204 09:11:13.150645 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 59 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 58 index: 72. Preceding OpId from leader: term: 59 index: 72. (term mismatch)
I20260204 09:11:13.150720 10246 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting all ops after (but not including) 71
I20260204 09:11:13.150732 10246 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting uncommitted NO_OP operation due to leader change: 58.72
I20260204 09:11:13.150745 10246 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 59 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:13.150964 10523 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 72, Last known committed idx: 71, Time since last communication: 0.000s
I20260204 09:11:13.151916 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 59 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 57 index: 71. Preceding OpId from leader: term: 59 index: 72. (index mismatch)
I20260204 09:11:13.152079 10535 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 72, Last known committed idx: 71, Time since last communication: 0.000s
I20260204 09:11:13.335346 10532 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 59 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:13.335460 10532 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 59 FOLLOWER]: Advancing to term 60
I20260204 09:11:13.336079 10532 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 60 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:13.336223 10532 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 60 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:13.336410 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 60 candidate_status { last_received { term: 59 index: 72 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:13.336410 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 60 candidate_status { last_received { term: 59 index: 72 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:13.336658 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 60 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11502cf05241427fb9853e628add7746; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:13.336776 10532 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 60 FOLLOWER]: Leader election lost for term 60. Reason: could not achieve majority
I20260204 09:11:13.348086 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 60 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 59. Current term is 60. Ops: []
I20260204 09:11:13.348299 10523 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 59.72, Next index: 73, Last known committed idx: 72, Time since last communication: 0.000s
I20260204 09:11:13.348407 10535 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 59 LEADER]: Stepping down as leader of term 59
I20260204 09:11:13.348448 10535 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 59 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:13.348510 10535 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 72, Committed index: 72, Last appended: 59.72, Last appended by leader: 72, Current term: 59, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:13.348600 10535 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 59 FOLLOWER]: Advancing to term 60
I20260204 09:11:13.412595 10522 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 59 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:13.412693 10522 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 59 FOLLOWER]: Advancing to term 60
I20260204 09:11:13.413342 10522 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 60 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:13.413535 10522 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 60 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:13.413762 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 60 candidate_status { last_received { term: 59 index: 72 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:13.413762 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 60 candidate_status { last_received { term: 59 index: 72 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:13.413898 10246 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 60 FOLLOWER]: Leader election vote request: Denying vote to candidate bd38b0e96f264071a69be73b6b4f14c1 in current term 60: Already voted for candidate 11502cf05241427fb9853e628add7746 in this term.
I20260204 09:11:13.414408 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 60 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 60.
I20260204 09:11:13.414563 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 60 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:13.414646 10522 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 60 FOLLOWER]: Leader election won for term 60
I20260204 09:11:13.414708 10522 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 60 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:13.414760 10522 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 72, Committed index: 72, Last appended: 59.72, Last appended by leader: 72, Current term: 60, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:13.415192 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 59 to 60, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 60 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:13.451550 10532 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 60 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:13.451635 10532 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 60 FOLLOWER]: Advancing to term 61
I20260204 09:11:13.452280 10532 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 61 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:13.452432 10532 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 61 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:13.452620 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 61 candidate_status { last_received { term: 59 index: 72 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:13.452683 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 60 FOLLOWER]: Advancing to term 61
I20260204 09:11:13.452631 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 61 candidate_status { last_received { term: 59 index: 72 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:13.453222 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 61 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 61.
I20260204 09:11:13.453397 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 61 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:13.453486 10532 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 61 FOLLOWER]: Leader election won for term 61
I20260204 09:11:13.453534 10532 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 61 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:13.453577 10532 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 72, Committed index: 72, Last appended: 59.72, Last appended by leader: 72, Current term: 61, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:13.453964 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 60 to 61, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 61 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:13.528573 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 61 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 60. Current term is 61. Ops: []
I20260204 09:11:13.528859 10522 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 73, Last known committed idx: 72, Time since last communication: 0.000s
I20260204 09:11:13.528973 10522 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 60 LEADER]: Stepping down as leader of term 60
I20260204 09:11:13.529003 10522 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 60 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:13.529068 10522 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 72, Committed index: 72, Last appended: 60.73, Last appended by leader: 73, Current term: 60, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:13.529134 10522 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 60 FOLLOWER]: Advancing to term 61
I20260204 09:11:13.551380 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 61 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 59 index: 72. Preceding OpId from leader: term: 61 index: 73. (index mismatch)
I20260204 09:11:13.551612 10532 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 73, Last known committed idx: 72, Time since last communication: 0.000s
I20260204 09:11:13.552577 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 61 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 60 index: 73. Preceding OpId from leader: term: 61 index: 73. (term mismatch)
I20260204 09:11:13.552637 10322 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Aborting all ops after (but not including) 72
I20260204 09:11:13.552654 10322 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Aborting uncommitted NO_OP operation due to leader change: 60.73
I20260204 09:11:13.552680 10322 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 61 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:13.552841 10532 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 73, Last known committed idx: 72, Time since last communication: 0.000s
I20260204 09:11:13.758965 10522 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 61 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:13.759053 10522 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 61 FOLLOWER]: Advancing to term 62
I20260204 09:11:13.759842 10522 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 62 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:13.760013 10522 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 62 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:13.760264 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 62 candidate_status { last_received { term: 61 index: 73 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:13.760308 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 62 candidate_status { last_received { term: 61 index: 73 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:13.760532 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 62 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:13.760636 10522 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 62 FOLLOWER]: Leader election lost for term 62. Reason: could not achieve majority
I20260204 09:11:13.770974 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 62 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 61. Current term is 62. Ops: []
I20260204 09:11:13.771214 10536 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 61.73, Next index: 74, Last known committed idx: 73, Time since last communication: 0.000s
I20260204 09:11:13.771343 10527 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 61 LEADER]: Stepping down as leader of term 61
I20260204 09:11:13.771385 10527 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 61 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:13.771440 10527 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 73, Committed index: 73, Last appended: 61.73, Last appended by leader: 73, Current term: 61, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:13.771528 10527 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 61 FOLLOWER]: Advancing to term 62
I20260204 09:11:13.815898 10535 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 61 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:13.815999 10535 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 61 FOLLOWER]: Advancing to term 62
I20260204 09:11:13.816656 10535 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 62 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:13.816838 10535 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 62 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:13.817040 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 62 candidate_status { last_received { term: 61 index: 73 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:13.817044 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 62 candidate_status { last_received { term: 61 index: 73 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:13.817154 10322 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 62 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in current term 62: Already voted for candidate bd38b0e96f264071a69be73b6b4f14c1 in this term.
I20260204 09:11:13.817653 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 62 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 62.
I20260204 09:11:13.817822 10362 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 62 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:13.817911 10535 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 62 FOLLOWER]: Leader election won for term 62
I20260204 09:11:13.817965 10535 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 62 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:13.818012 10535 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 73, Committed index: 73, Last appended: 61.73, Last appended by leader: 73, Current term: 62, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:13.818409 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 61 to 62, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 62 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:13.885488 10522 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 62 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:13.885581 10522 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 62 FOLLOWER]: Advancing to term 63
I20260204 09:11:13.886277 10522 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 63 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:13.886454 10522 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 63 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:13.886679 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 63 candidate_status { last_received { term: 61 index: 73 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:13.886703 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 63 candidate_status { last_received { term: 61 index: 73 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:13.886793 10246 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 62 FOLLOWER]: Advancing to term 63
I20260204 09:11:13.887387 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 63 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 63.
I20260204 09:11:13.887562 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 63 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:13.887665 10522 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 63 FOLLOWER]: Leader election won for term 63
I20260204 09:11:13.887722 10522 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 63 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:13.887773 10522 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 73, Committed index: 73, Last appended: 61.73, Last appended by leader: 73, Current term: 63, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:13.888252 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 62 to 63, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 63 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:13.903839 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 63 LEADER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 62. Current term is 63. Ops: []
I20260204 09:11:13.904194 10535 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 0.0, Next index: 74, Last known committed idx: 73, Time since last communication: 0.000s
I20260204 09:11:13.904307 10535 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer bd38b0e96f264071a69be73b6b4f14c1 log is divergent from this leader: its last log entry 63.74 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 73
I20260204 09:11:13.904338 10523 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 62 LEADER]: Stepping down as leader of term 62
I20260204 09:11:13.904389 10523 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 62 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:13.904459 10523 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 73, Committed index: 73, Last appended: 62.74, Last appended by leader: 74, Current term: 62, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:13.904551 10523 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 62 FOLLOWER]: Advancing to term 63
I20260204 09:11:13.978256 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:13.987478 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 63 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 62 index: 74. Preceding OpId from leader: term: 63 index: 74. (term mismatch)
I20260204 09:11:13.987550 10397 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2: Aborting all ops after (but not including) 73
I20260204 09:11:13.987568 10397 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2: Aborting uncommitted NO_OP operation due to leader change: 62.74
I20260204 09:11:13.987586 10397 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 63 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:13.987793 10522 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 74, Last known committed idx: 73, Time since last communication: 0.000s
I20260204 09:11:13.988840 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 63 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 61 index: 73. Preceding OpId from leader: term: 63 index: 74. (index mismatch)
I20260204 09:11:13.989007 10534 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 74, Last known committed idx: 73, Time since last communication: 0.000s
I20260204 09:11:14.178243 10527 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 63 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:14.178341 10527 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 63 FOLLOWER]: Advancing to term 64
I20260204 09:11:14.178969 10527 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 64 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:14.179129 10527 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 64 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:14.179338 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 64 candidate_status { last_received { term: 63 index: 74 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:14.179335 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 64 candidate_status { last_received { term: 63 index: 74 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:14.179590 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 64 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11502cf05241427fb9853e628add7746; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:14.179678 10527 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 64 FOLLOWER]: Leader election lost for term 64. Reason: could not achieve majority
I20260204 09:11:14.193732 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 64 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 63. Current term is 64. Ops: []
I20260204 09:11:14.193955 10522 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 63.74, Next index: 75, Last known committed idx: 74, Time since last communication: 0.000s
I20260204 09:11:14.194077 10522 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 63 LEADER]: Stepping down as leader of term 63
I20260204 09:11:14.194109 10522 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 63 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:14.194168 10522 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 74, Committed index: 74, Last appended: 63.74, Last appended by leader: 74, Current term: 63, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:14.194244 10522 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 63 FOLLOWER]: Advancing to term 64
I20260204 09:11:14.213369 10523 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 63 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:14.213460 10523 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 63 FOLLOWER]: Advancing to term 64
I20260204 09:11:14.214043 10523 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 64 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:14.214184 10523 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 64 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:14.214390 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 64 candidate_status { last_received { term: 63 index: 74 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:14.214392 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 64 candidate_status { last_received { term: 63 index: 74 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:14.214506 10246 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 64 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in current term 64: Already voted for candidate 11502cf05241427fb9853e628add7746 in this term.
I20260204 09:11:14.215035 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 64 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 64.
I20260204 09:11:14.215201 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 64 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:14.215286 10523 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 64 FOLLOWER]: Leader election won for term 64
I20260204 09:11:14.215332 10523 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 64 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:14.215368 10523 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 74, Committed index: 74, Last appended: 63.74, Last appended by leader: 74, Current term: 64, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:14.215770 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 63 to 64, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 64 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:14.293118 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 64 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 63 index: 74. Preceding OpId from leader: term: 64 index: 75. (index mismatch)
I20260204 09:11:14.293399 10523 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 75, Last known committed idx: 74, Time since last communication: 0.000s
I20260204 09:11:14.294448 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 64 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 63 index: 74. Preceding OpId from leader: term: 64 index: 75. (index mismatch)
I20260204 09:11:14.294674 10535 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 75, Last known committed idx: 74, Time since last communication: 0.000s
I20260204 09:11:14.494238 10527 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 64 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:14.494324 10527 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 64 FOLLOWER]: Advancing to term 65
I20260204 09:11:14.494972 10527 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 65 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:14.495139 10527 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 65 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:14.495353 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 65 candidate_status { last_received { term: 64 index: 75 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:14.495353 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 65 candidate_status { last_received { term: 64 index: 75 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:14.495612 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 65 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11502cf05241427fb9853e628add7746; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:14.495719 10527 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 65 FOLLOWER]: Leader election lost for term 65. Reason: could not achieve majority
I20260204 09:11:14.507097 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 65 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 64. Current term is 65. Ops: []
I20260204 09:11:14.507323 10523 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 64.75, Next index: 76, Last known committed idx: 75, Time since last communication: 0.000s
I20260204 09:11:14.507436 10523 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 64 LEADER]: Stepping down as leader of term 64
I20260204 09:11:14.507467 10523 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 64 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:14.507527 10523 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 75, Committed index: 75, Last appended: 64.75, Last appended by leader: 75, Current term: 64, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:14.507592 10523 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 64 FOLLOWER]: Advancing to term 65
I20260204 09:11:14.509696 10522 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 64 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:14.509752 10522 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 64 FOLLOWER]: Advancing to term 65
I20260204 09:11:14.510288 10522 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 65 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:14.510416 10522 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 65 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:14.510576 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 65 candidate_status { last_received { term: 64 index: 75 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:14.510599 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 65 candidate_status { last_received { term: 64 index: 75 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:14.510663 10246 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 65 FOLLOWER]: Leader election vote request: Denying vote to candidate bd38b0e96f264071a69be73b6b4f14c1 in current term 65: Already voted for candidate 11502cf05241427fb9853e628add7746 in this term.
I20260204 09:11:14.511155 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 65 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 65.
I20260204 09:11:14.511313 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 65 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:14.511391 10522 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 65 FOLLOWER]: Leader election won for term 65
I20260204 09:11:14.511437 10522 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 65 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:14.511478 10522 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 75, Committed index: 75, Last appended: 64.75, Last appended by leader: 75, Current term: 65, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:14.511907 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 64 to 65, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 65 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:14.632140 10527 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 65 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:14.632239 10527 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 65 FOLLOWER]: Advancing to term 66
I20260204 09:11:14.632892 10527 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 66 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:14.633062 10527 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 66 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:14.633262 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 66 candidate_status { last_received { term: 64 index: 75 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:14.633272 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 66 candidate_status { last_received { term: 64 index: 75 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:14.633399 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 65 FOLLOWER]: Advancing to term 66
I20260204 09:11:14.633958 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 66 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 66.
I20260204 09:11:14.634101 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 66 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 65. Current term is 66. Ops: []
I20260204 09:11:14.634109 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 66 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:14.634267 10527 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 66 FOLLOWER]: Leader election won for term 66
I20260204 09:11:14.634287 10522 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 76, Last known committed idx: 75, Time since last communication: 0.000s
I20260204 09:11:14.634352 10522 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 65 LEADER]: Stepping down as leader of term 65
I20260204 09:11:14.634402 10522 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 65 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:14.634402 10527 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 66 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:14.634514 10527 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 75, Committed index: 75, Last appended: 64.75, Last appended by leader: 75, Current term: 66, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:14.634524 10522 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 75, Committed index: 75, Last appended: 65.76, Last appended by leader: 76, Current term: 65, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:14.634626 10522 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 65 FOLLOWER]: Advancing to term 66
I20260204 09:11:14.634953 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 65 to 66, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 66 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:14.711274 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 66 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 64 index: 75. Preceding OpId from leader: term: 66 index: 76. (index mismatch)
I20260204 09:11:14.711572 10527 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 76, Last known committed idx: 75, Time since last communication: 0.000s
I20260204 09:11:14.712543 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 66 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 65 index: 76. Preceding OpId from leader: term: 66 index: 76. (term mismatch)
I20260204 09:11:14.712594 10322 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Aborting all ops after (but not including) 75
I20260204 09:11:14.712611 10322 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Aborting uncommitted NO_OP operation due to leader change: 65.76
I20260204 09:11:14.712627 10322 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 66 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:14.712904 10540 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 76, Last known committed idx: 75, Time since last communication: 0.000s
I20260204 09:11:14.895159 10522 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 66 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:14.895253 10522 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 66 FOLLOWER]: Advancing to term 67
I20260204 09:11:14.895859 10522 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 67 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:14.895999 10522 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 67 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:14.896217 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 67 candidate_status { last_received { term: 66 index: 76 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:14.896221 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 67 candidate_status { last_received { term: 66 index: 76 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:14.896462 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 67 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:14.896550 10522 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 67 FOLLOWER]: Leader election lost for term 67. Reason: could not achieve majority
I20260204 09:11:14.896917 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 67 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 66. Current term is 67. Ops: []
I20260204 09:11:14.897071 10527 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 66.76, Next index: 77, Last known committed idx: 76, Time since last communication: 0.000s
I20260204 09:11:14.897168 10539 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 66 LEADER]: Stepping down as leader of term 66
I20260204 09:11:14.897209 10539 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 66 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:14.897266 10539 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 76, Committed index: 76, Last appended: 66.76, Last appended by leader: 76, Current term: 66, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:14.897341 10539 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 66 FOLLOWER]: Advancing to term 67
I20260204 09:11:14.910643 10523 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 66 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:14.910712 10523 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 66 FOLLOWER]: Advancing to term 67
I20260204 09:11:14.911255 10523 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 67 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:14.911376 10523 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 67 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:14.911553 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 67 candidate_status { last_received { term: 66 index: 76 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:14.911550 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 67 candidate_status { last_received { term: 66 index: 76 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:14.911651 10322 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 67 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in current term 67: Already voted for candidate bd38b0e96f264071a69be73b6b4f14c1 in this term.
I20260204 09:11:14.912164 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 67 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 67.
I20260204 09:11:14.912308 10362 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 67 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:14.912391 10523 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 67 FOLLOWER]: Leader election won for term 67
I20260204 09:11:14.912442 10523 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 67 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:14.912493 10523 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 76, Committed index: 76, Last appended: 66.76, Last appended by leader: 76, Current term: 67, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:14.912916 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 66 to 67, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 67 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:14.978514 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:14.994354 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 67 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 66 index: 76. Preceding OpId from leader: term: 67 index: 77. (index mismatch)
I20260204 09:11:14.994611 10523 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 77, Last known committed idx: 76, Time since last communication: 0.000s
I20260204 09:11:14.995527 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 67 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 66 index: 76. Preceding OpId from leader: term: 67 index: 77. (index mismatch)
I20260204 09:11:14.995746 10523 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 77, Last known committed idx: 76, Time since last communication: 0.000s
I20260204 09:11:15.178399 10522 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 67 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:15.178481 10522 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 67 FOLLOWER]: Advancing to term 68
I20260204 09:11:15.179106 10522 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 68 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:15.179247 10522 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 68 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:15.179407 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 68 candidate_status { last_received { term: 67 index: 77 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:15.179409 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 68 candidate_status { last_received { term: 67 index: 77 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:15.179632 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 68 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:15.179718 10522 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 68 FOLLOWER]: Leader election lost for term 68. Reason: could not achieve majority
I20260204 09:11:15.197110 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 68 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 67. Current term is 68. Ops: []
I20260204 09:11:15.197366 10541 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 67.77, Next index: 78, Last known committed idx: 77, Time since last communication: 0.000s
I20260204 09:11:15.197481 10541 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 67 LEADER]: Stepping down as leader of term 67
I20260204 09:11:15.197512 10541 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 67 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:15.197575 10541 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 77, Committed index: 77, Last appended: 67.77, Last appended by leader: 77, Current term: 67, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:15.197652 10541 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 67 FOLLOWER]: Advancing to term 68
I20260204 09:11:15.276224 10527 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 67 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:15.276317 10527 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 67 FOLLOWER]: Advancing to term 68
I20260204 09:11:15.276932 10527 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 68 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:15.277081 10527 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 68 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:15.277311 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 68 candidate_status { last_received { term: 67 index: 77 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:15.277318 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 68 candidate_status { last_received { term: 67 index: 77 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:15.277446 10322 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 68 FOLLOWER]: Leader election vote request: Denying vote to candidate 11502cf05241427fb9853e628add7746 in current term 68: Already voted for candidate bd38b0e96f264071a69be73b6b4f14c1 in this term.
I20260204 09:11:15.278055 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 68 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 68.
I20260204 09:11:15.278226 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 68 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:15.278312 10527 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 68 FOLLOWER]: Leader election won for term 68
I20260204 09:11:15.278366 10527 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 68 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:15.278417 10527 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 77, Committed index: 77, Last appended: 67.77, Last appended by leader: 77, Current term: 68, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:15.278878 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 67 to 68, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 68 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:15.298609 10522 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 68 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:15.298695 10522 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 68 FOLLOWER]: Advancing to term 69
I20260204 09:11:15.299288 10522 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 69 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:15.299419 10522 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 69 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:15.299631 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 69 candidate_status { last_received { term: 67 index: 77 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:15.299629 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 69 candidate_status { last_received { term: 67 index: 77 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:15.299757 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 68 FOLLOWER]: Advancing to term 69
I20260204 09:11:15.300316 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 69 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 69.
I20260204 09:11:15.300504 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 69 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:15.300614 10522 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 69 FOLLOWER]: Leader election won for term 69
I20260204 09:11:15.300753 10522 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 69 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:15.300806 10522 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 77, Committed index: 77, Last appended: 67.77, Last appended by leader: 77, Current term: 69, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:15.301249 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 68 to 69, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 69 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:15.381505 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 69 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 68. Current term is 69. Ops: []
I20260204 09:11:15.381819 10527 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 78, Last known committed idx: 77, Time since last communication: 0.000s
I20260204 09:11:15.381935 10527 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 68 LEADER]: Stepping down as leader of term 68
I20260204 09:11:15.381968 10527 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 68 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:15.382023 10527 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 77, Committed index: 77, Last appended: 68.78, Last appended by leader: 78, Current term: 68, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:15.382089 10527 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 68 FOLLOWER]: Advancing to term 69
I20260204 09:11:15.389605 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 69 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 68 index: 78. Preceding OpId from leader: term: 69 index: 78. (term mismatch)
I20260204 09:11:15.389670 10246 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting all ops after (but not including) 77
I20260204 09:11:15.389684 10246 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting uncommitted NO_OP operation due to leader change: 68.78
I20260204 09:11:15.389698 10246 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 69 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:15.389925 10522 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 78, Last known committed idx: 77, Time since last communication: 0.000s
I20260204 09:11:15.390857 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 69 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 67 index: 77. Preceding OpId from leader: term: 69 index: 78. (index mismatch)
I20260204 09:11:15.391052 10522 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 78, Last known committed idx: 77, Time since last communication: 0.000s
I20260204 09:11:15.492157 10541 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 69 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:15.492249 10541 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 69 FOLLOWER]: Advancing to term 70
I20260204 09:11:15.492872 10541 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 70 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:15.493031 10541 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 70 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:15.493191 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 70 candidate_status { last_received { term: 69 index: 78 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:15.493202 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 70 candidate_status { last_received { term: 69 index: 78 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:15.493451 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 70 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:15.493537 10541 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 70 FOLLOWER]: Leader election lost for term 70. Reason: could not achieve majority
I20260204 09:11:15.502928 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 70 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 69. Current term is 70. Ops: []
I20260204 09:11:15.503146 10543 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 69.78, Next index: 79, Last known committed idx: 78, Time since last communication: 0.000s
I20260204 09:11:15.503258 10543 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 69 LEADER]: Stepping down as leader of term 69
I20260204 09:11:15.503291 10543 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 69 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:15.503355 10543 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 78, Committed index: 78, Last appended: 69.78, Last appended by leader: 78, Current term: 69, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:15.503432 10543 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 69 FOLLOWER]: Advancing to term 70
I20260204 09:11:15.598387 10541 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 70 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:15.598503 10541 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 70 FOLLOWER]: Advancing to term 71
I20260204 09:11:15.599228 10541 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 71 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:15.599416 10541 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 71 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:15.599604 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 71 candidate_status { last_received { term: 69 index: 78 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:15.599604 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 71 candidate_status { last_received { term: 69 index: 78 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:15.599737 10246 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 69 FOLLOWER]: Advancing to term 71
I20260204 09:11:15.599743 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 70 FOLLOWER]: Advancing to term 71
I20260204 09:11:15.600432 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 71 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 71.
I20260204 09:11:15.600432 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 71 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 71.
I20260204 09:11:15.600661 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 71 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters:
I20260204 09:11:15.600806 10541 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 71 FOLLOWER]: Leader election won for term 71
I20260204 09:11:15.600863 10541 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 71 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:15.600920 10541 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 78, Committed index: 78, Last appended: 69.78, Last appended by leader: 78, Current term: 71, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:15.601380 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 69 to 71, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 71 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:15.711813 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 71 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 69 index: 78. Preceding OpId from leader: term: 71 index: 79. (index mismatch)
I20260204 09:11:15.712095 10541 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 79, Last known committed idx: 78, Time since last communication: 0.000s
I20260204 09:11:15.713120 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 71 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 69 index: 78. Preceding OpId from leader: term: 71 index: 79. (index mismatch)
I20260204 09:11:15.713303 10541 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 79, Last known committed idx: 78, Time since last communication: 0.000s
I20260204 09:11:15.813856 10527 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 71 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:15.813961 10527 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 71 FOLLOWER]: Advancing to term 72
I20260204 09:11:15.814814 10527 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 72 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:15.814934 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 72 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 71. Current term is 72. Ops: []
I20260204 09:11:15.815021 10527 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 72 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:15.815092 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 72 candidate_status { last_received { term: 71 index: 79 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:15.815135 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 72 candidate_status { last_received { term: 71 index: 79 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:15.815173 10541 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 71.79, Next index: 80, Last known committed idx: 79, Time since last communication: 0.000s
I20260204 09:11:15.815251 10541 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 71 LEADER]: Stepping down as leader of term 71
I20260204 09:11:15.815284 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 72 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11502cf05241427fb9853e628add7746; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:15.815282 10541 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 71 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:15.815433 10527 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 72 FOLLOWER]: Leader election lost for term 72. Reason: could not achieve majority
I20260204 09:11:15.815414 10541 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 79, Committed index: 79, Last appended: 71.79, Last appended by leader: 79, Current term: 71, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:15.815547 10541 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 71 FOLLOWER]: Advancing to term 72
I20260204 09:11:15.900820 10543 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 71 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:15.900930 10543 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 71 FOLLOWER]: Advancing to term 72
I20260204 09:11:15.901651 10543 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 72 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:15.901815 10543 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 72 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:15.902042 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 72 candidate_status { last_received { term: 71 index: 79 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:15.902042 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 72 candidate_status { last_received { term: 71 index: 79 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:15.902184 10246 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 72 FOLLOWER]: Leader election vote request: Denying vote to candidate bd38b0e96f264071a69be73b6b4f14c1 in current term 72: Already voted for candidate 11502cf05241427fb9853e628add7746 in this term.
I20260204 09:11:15.902710 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 72 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 72.
I20260204 09:11:15.902880 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 72 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:15.902969 10543 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 72 FOLLOWER]: Leader election won for term 72
I20260204 09:11:15.903040 10543 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 72 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:15.903096 10543 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 79, Committed index: 79, Last appended: 71.79, Last appended by leader: 79, Current term: 72, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:15.903510 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 71 to 72, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 72 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:15.924786 10527 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 72 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:15.924875 10527 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 72 FOLLOWER]: Advancing to term 73
I20260204 09:11:15.925508 10527 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 73 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:15.925650 10527 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 73 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:15.925858 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 73 candidate_status { last_received { term: 71 index: 79 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:15.925858 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 73 candidate_status { last_received { term: 71 index: 79 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:15.925948 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 72 FOLLOWER]: Advancing to term 73
I20260204 09:11:15.926446 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 73 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 73.
I20260204 09:11:15.926601 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 73 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:15.926685 10527 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 73 FOLLOWER]: Leader election won for term 73
I20260204 09:11:15.926797 10527 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 73 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:15.926851 10527 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 79, Committed index: 79, Last appended: 71.79, Last appended by leader: 79, Current term: 73, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:15.927240 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 72 to 73, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 73 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:15.978780 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:15.983806 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 73 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 72. Current term is 73. Ops: []
I20260204 09:11:15.984042 10543 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 80, Last known committed idx: 79, Time since last communication: 0.000s
I20260204 09:11:15.984169 10543 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 72 LEADER]: Stepping down as leader of term 72
I20260204 09:11:15.984205 10543 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 72 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:15.984257 10543 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 79, Committed index: 79, Last appended: 72.80, Last appended by leader: 80, Current term: 72, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:15.984328 10543 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 72 FOLLOWER]: Advancing to term 73
I20260204 09:11:16.008651 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 73 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 72 index: 80. Preceding OpId from leader: term: 73 index: 80. (term mismatch)
I20260204 09:11:16.008726 10322 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Aborting all ops after (but not including) 79
I20260204 09:11:16.008739 10322 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Aborting uncommitted NO_OP operation due to leader change: 72.80
I20260204 09:11:16.008752 10322 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 73 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:16.008932 10527 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 80, Last known committed idx: 79, Time since last communication: 0.000s
I20260204 09:11:16.009855 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 73 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 71 index: 79. Preceding OpId from leader: term: 73 index: 80. (index mismatch)
I20260204 09:11:16.009997 10527 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 80, Last known committed idx: 79, Time since last communication: 0.000s
I20260204 09:11:16.210419 10541 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 73 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:16.210512 10541 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 73 FOLLOWER]: Advancing to term 74
I20260204 09:11:16.211140 10541 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 74 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:16.211294 10541 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 74 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:16.211508 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 74 candidate_status { last_received { term: 73 index: 80 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:16.211508 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 74 candidate_status { last_received { term: 73 index: 80 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:16.211773 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 74 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:16.211858 10541 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 74 FOLLOWER]: Leader election lost for term 74. Reason: could not achieve majority
I20260204 09:11:16.227185 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 74 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 73. Current term is 74. Ops: []
I20260204 09:11:16.227416 10527 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 73.80, Next index: 81, Last known committed idx: 80, Time since last communication: 0.000s
I20260204 09:11:16.227515 10527 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 73 LEADER]: Stepping down as leader of term 73
I20260204 09:11:16.227546 10527 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 73 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:16.227596 10527 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 80, Committed index: 80, Last appended: 73.80, Last appended by leader: 80, Current term: 73, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:16.227671 10527 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 73 FOLLOWER]: Advancing to term 74
I20260204 09:11:16.320539 10543 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 73 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:16.320641 10543 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 73 FOLLOWER]: Advancing to term 74
I20260204 09:11:16.321377 10543 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 74 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:16.321537 10543 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 74 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:16.321761 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 74 candidate_status { last_received { term: 73 index: 80 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:16.321761 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 74 candidate_status { last_received { term: 73 index: 80 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:16.321890 10397 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 74 FOLLOWER]: Leader election vote request: Denying vote to candidate bd38b0e96f264071a69be73b6b4f14c1 in current term 74: Already voted for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in this term.
I20260204 09:11:16.322430 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 74 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 74.
I20260204 09:11:16.322582 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 74 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:16.322667 10543 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 74 FOLLOWER]: Leader election won for term 74
I20260204 09:11:16.322723 10543 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 74 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:16.322778 10543 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 80, Committed index: 80, Last appended: 73.80, Last appended by leader: 80, Current term: 74, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:16.323170 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 73 to 74, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 74 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:16.327188 10541 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 74 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:16.327237 10541 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 74 FOLLOWER]: Advancing to term 75
I20260204 09:11:16.327734 10541 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 75 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:16.327847 10541 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 75 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:16.328006 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 75 candidate_status { last_received { term: 73 index: 80 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:16.328006 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 75 candidate_status { last_received { term: 73 index: 80 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:16.328097 10246 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 74 FOLLOWER]: Advancing to term 75
I20260204 09:11:16.328583 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 75 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 75.
I20260204 09:11:16.328714 10362 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 75 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:16.328787 10541 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 75 FOLLOWER]: Leader election won for term 75
I20260204 09:11:16.328902 10541 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 75 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:16.328951 10541 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 80, Committed index: 80, Last appended: 73.80, Last appended by leader: 80, Current term: 75, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:16.329331 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 74 to 75, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 75 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:16.399495 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 75 LEADER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 74. Current term is 75. Ops: []
I20260204 09:11:16.399780 10543 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 81, Last known committed idx: 80, Time since last communication: 0.000s
I20260204 09:11:16.399901 10543 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer 8b12f9075d9d4ffa9fd711322da0c4d2 log is divergent from this leader: its last log entry 75.81 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 80
I20260204 09:11:16.399940 10542 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 74 LEADER]: Stepping down as leader of term 74
I20260204 09:11:16.399981 10542 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 74 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:16.400038 10542 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 80, Committed index: 80, Last appended: 74.81, Last appended by leader: 81, Current term: 74, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:16.400121 10542 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 74 FOLLOWER]: Advancing to term 75
I20260204 09:11:16.433810 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 75 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 73 index: 80. Preceding OpId from leader: term: 75 index: 81. (index mismatch)
I20260204 09:11:16.434098 10541 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 81, Last known committed idx: 80, Time since last communication: 0.000s
I20260204 09:11:16.435230 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 75 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 74 index: 81. Preceding OpId from leader: term: 75 index: 81. (term mismatch)
I20260204 09:11:16.435279 10322 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Aborting all ops after (but not including) 80
I20260204 09:11:16.435295 10322 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Aborting uncommitted NO_OP operation due to leader change: 74.81
I20260204 09:11:16.435312 10322 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 75 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:16.435532 10548 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 81, Last known committed idx: 80, Time since last communication: 0.000s
I20260204 09:11:16.536208 10527 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 75 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:16.536305 10527 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 75 FOLLOWER]: Advancing to term 76
I20260204 09:11:16.536918 10527 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 76 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:16.537060 10527 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 76 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:16.537247 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 76 candidate_status { last_received { term: 75 index: 81 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:16.537247 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 76 candidate_status { last_received { term: 75 index: 81 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:16.537499 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 76 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11502cf05241427fb9853e628add7746; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:16.537593 10527 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 76 FOLLOWER]: Leader election lost for term 76. Reason: could not achieve majority
I20260204 09:11:16.552933 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 76 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 75. Current term is 76. Ops: []
I20260204 09:11:16.553184 10548 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 75.81, Next index: 82, Last known committed idx: 81, Time since last communication: 0.000s
I20260204 09:11:16.553324 10547 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 75 LEADER]: Stepping down as leader of term 75
I20260204 09:11:16.553401 10547 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 75 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:16.553463 10547 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 81, Committed index: 81, Last appended: 75.81, Last appended by leader: 81, Current term: 75, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:16.553552 10547 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 75 FOLLOWER]: Advancing to term 76
I20260204 09:11:16.625581 10542 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 75 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:16.625695 10542 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 75 FOLLOWER]: Advancing to term 76
I20260204 09:11:16.626350 10542 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 76 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:16.626499 10542 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 76 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:16.626740 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 76 candidate_status { last_received { term: 75 index: 81 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:16.626834 10246 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 76 FOLLOWER]: Leader election vote request: Denying vote to candidate bd38b0e96f264071a69be73b6b4f14c1 in current term 76: Already voted for candidate 11502cf05241427fb9853e628add7746 in this term.
I20260204 09:11:16.626740 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 76 candidate_status { last_received { term: 75 index: 81 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:16.627602 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 76 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 76.
I20260204 09:11:16.627817 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 76 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters:
I20260204 09:11:16.627928 10542 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 76 FOLLOWER]: Leader election won for term 76
I20260204 09:11:16.627977 10542 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 76 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:16.628031 10542 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 81, Committed index: 81, Last appended: 75.81, Last appended by leader: 81, Current term: 76, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:16.628461 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 75 to 76, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 76 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:16.671085 10527 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 76 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:16.671183 10527 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 76 FOLLOWER]: Advancing to term 77
I20260204 09:11:16.671803 10527 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 77 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:16.671962 10527 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 77 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:16.672160 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 77 candidate_status { last_received { term: 75 index: 81 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:16.672233 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 76 FOLLOWER]: Advancing to term 77
I20260204 09:11:16.672169 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 77 candidate_status { last_received { term: 75 index: 81 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:16.672829 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 77 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 77.
I20260204 09:11:16.673002 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 77 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:16.673085 10527 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 77 FOLLOWER]: Leader election won for term 77
I20260204 09:11:16.673130 10527 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 77 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:16.673163 10527 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 81, Committed index: 81, Last appended: 75.81, Last appended by leader: 81, Current term: 77, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:16.673588 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 76 to 77, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 77 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:16.712913 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 77 LEADER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 76. Current term is 77. Ops: []
I20260204 09:11:16.713157 10542 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 82, Last known committed idx: 81, Time since last communication: 0.000s
I20260204 09:11:16.713254 10542 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer 11502cf05241427fb9853e628add7746 log is divergent from this leader: its last log entry 77.82 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 81
I20260204 09:11:16.713289 10543 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 76 LEADER]: Stepping down as leader of term 76
I20260204 09:11:16.713325 10543 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 76 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:16.713394 10543 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 81, Committed index: 81, Last appended: 76.82, Last appended by leader: 82, Current term: 76, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:16.713466 10543 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 76 FOLLOWER]: Advancing to term 77
I20260204 09:11:16.761860 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 77 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 76 index: 82. Preceding OpId from leader: term: 77 index: 82. (term mismatch)
I20260204 09:11:16.761945 10322 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Aborting all ops after (but not including) 81
I20260204 09:11:16.761967 10322 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Aborting uncommitted NO_OP operation due to leader change: 76.82
I20260204 09:11:16.761986 10322 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 77 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:16.762197 10527 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 82, Last known committed idx: 81, Time since last communication: 0.000s
I20260204 09:11:16.763288 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 77 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 75 index: 81. Preceding OpId from leader: term: 77 index: 82. (index mismatch)
I20260204 09:11:16.763553 10546 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 82, Last known committed idx: 81, Time since last communication: 0.000s
I20260204 09:11:16.864794 10547 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 77 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:16.864897 10547 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 77 FOLLOWER]: Advancing to term 78
I20260204 09:11:16.865609 10547 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 78 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:16.865790 10547 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 78 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:16.865980 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 78 candidate_status { last_received { term: 77 index: 82 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:16.866053 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 77 FOLLOWER]: Advancing to term 78
I20260204 09:11:16.865990 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 78 candidate_status { last_received { term: 77 index: 82 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:16.866577 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 78 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 78.
I20260204 09:11:16.866739 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 78 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:16.866832 10547 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 78 FOLLOWER]: Leader election won for term 78
I20260204 09:11:16.866879 10547 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 78 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:16.866923 10547 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 82, Committed index: 82, Last appended: 77.82, Last appended by leader: 82, Current term: 78, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:16.867384 10140 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 77 to 78, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 78 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:16.877017 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 78 LEADER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 77. Current term is 78. Ops: []
I20260204 09:11:16.877218 10527 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 77.82, Next index: 83, Last known committed idx: 82, Time since last communication: 0.000s
I20260204 09:11:16.877290 10527 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer 8b12f9075d9d4ffa9fd711322da0c4d2 log is divergent from this leader: its last log entry 78.83 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 82
I20260204 09:11:16.877324 10546 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 77 LEADER]: Stepping down as leader of term 77
I20260204 09:11:16.877377 10546 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 77 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:16.877439 10546 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 82, Committed index: 82, Last appended: 77.82, Last appended by leader: 82, Current term: 77, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:16.877524 10546 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 77 FOLLOWER]: Advancing to term 78
I20260204 09:11:16.966795 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 78 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 77 index: 82. Preceding OpId from leader: term: 78 index: 83. (index mismatch)
I20260204 09:11:16.967036 10547 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 83, Last known committed idx: 82, Time since last communication: 0.000s
I20260204 09:11:16.967530 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 78 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 77 index: 82. Preceding OpId from leader: term: 78 index: 83. (index mismatch)
I20260204 09:11:16.967810 10548 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 83, Last known committed idx: 82, Time since last communication: 0.000s
I20260204 09:11:16.979090 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:17.245276 10546 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 78 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:17.245388 10546 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 78 FOLLOWER]: Advancing to term 79
I20260204 09:11:17.246049 10546 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 79 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:17.246217 10546 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 79 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:17.246418 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 79 candidate_status { last_received { term: 78 index: 83 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:17.246419 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 79 candidate_status { last_received { term: 78 index: 83 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:17.246704 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 79 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11502cf05241427fb9853e628add7746; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:17.246793 10546 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 79 FOLLOWER]: Leader election lost for term 79. Reason: could not achieve majority
I20260204 09:11:17.257465 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 79 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 78. Current term is 79. Ops: []
I20260204 09:11:17.257670 10548 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 78.83, Next index: 84, Last known committed idx: 83, Time since last communication: 0.000s
I20260204 09:11:17.257790 10547 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 78 LEADER]: Stepping down as leader of term 78
I20260204 09:11:17.257838 10547 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 78 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:17.257899 10547 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 83, Committed index: 83, Last appended: 78.83, Last appended by leader: 83, Current term: 78, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:17.257977 10547 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 78 FOLLOWER]: Advancing to term 79
I20260204 09:11:17.327688 10543 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 78 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:17.327790 10543 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 78 FOLLOWER]: Advancing to term 79
I20260204 09:11:17.328425 10543 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 79 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:17.328608 10543 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 79 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:17.328830 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 79 candidate_status { last_received { term: 78 index: 83 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:17.328840 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 79 candidate_status { last_received { term: 78 index: 83 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:17.328950 10246 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 79 FOLLOWER]: Leader election vote request: Denying vote to candidate bd38b0e96f264071a69be73b6b4f14c1 in current term 79: Already voted for candidate 11502cf05241427fb9853e628add7746 in this term.
I20260204 09:11:17.329445 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 79 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 79.
I20260204 09:11:17.329595 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 79 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:17.329676 10543 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 79 FOLLOWER]: Leader election won for term 79
I20260204 09:11:17.329785 10543 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 79 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:17.329836 10543 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 83, Committed index: 83, Last appended: 78.83, Last appended by leader: 83, Current term: 79, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:17.330281 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 78 to 79, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 79 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:17.364181 10546 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 79 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:17.364259 10546 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 79 FOLLOWER]: Advancing to term 80
I20260204 09:11:17.364842 10546 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 80 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:17.365023 10546 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 80 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:17.365212 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 80 candidate_status { last_received { term: 78 index: 83 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:17.365198 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 80 candidate_status { last_received { term: 78 index: 83 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:17.365291 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 79 FOLLOWER]: Advancing to term 80
I20260204 09:11:17.365851 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 80 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 80.
I20260204 09:11:17.366025 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 80 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:17.366110 10546 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 80 FOLLOWER]: Leader election won for term 80
I20260204 09:11:17.366156 10546 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 80 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:17.366190 10546 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 83, Committed index: 83, Last appended: 78.83, Last appended by leader: 83, Current term: 80, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:17.366614 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 79 to 80, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 80 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:17.423796 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 80 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 79. Current term is 80. Ops: []
I20260204 09:11:17.424054 10543 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 84, Last known committed idx: 83, Time since last communication: 0.000s
I20260204 09:11:17.424162 10543 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 79 LEADER]: Stepping down as leader of term 79
I20260204 09:11:17.424190 10543 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 79 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:17.424243 10543 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 83, Committed index: 83, Last appended: 79.84, Last appended by leader: 84, Current term: 79, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:17.424316 10543 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 79 FOLLOWER]: Advancing to term 80
I20260204 09:11:17.448313 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 80 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 79 index: 84. Preceding OpId from leader: term: 80 index: 84. (term mismatch)
I20260204 09:11:17.448388 10322 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Aborting all ops after (but not including) 83
I20260204 09:11:17.448403 10322 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Aborting uncommitted NO_OP operation due to leader change: 79.84
I20260204 09:11:17.448419 10322 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 80 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:17.448621 10546 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 84, Last known committed idx: 83, Time since last communication: 0.000s
I20260204 09:11:17.449723 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 80 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 78 index: 83. Preceding OpId from leader: term: 80 index: 84. (index mismatch)
I20260204 09:11:17.449928 10551 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 84, Last known committed idx: 83, Time since last communication: 0.000s
I20260204 09:11:17.648910 10548 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 80 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:17.649035 10548 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 80 FOLLOWER]: Advancing to term 81
I20260204 09:11:17.649881 10548 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 81 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:17.650101 10548 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 81 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:17.650321 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 81 candidate_status { last_received { term: 80 index: 84 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:17.650336 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 81 candidate_status { last_received { term: 80 index: 84 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:17.650552 10362 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 81 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:17.650650 10548 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 81 FOLLOWER]: Leader election lost for term 81. Reason: could not achieve majority
I20260204 09:11:17.670615 10543 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 80 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:17.670722 10543 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 80 FOLLOWER]: Advancing to term 81
I20260204 09:11:17.671373 10543 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 81 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:17.671528 10543 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 81 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:17.671790 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 81 candidate_status { last_received { term: 80 index: 84 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:17.671805 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 81 candidate_status { last_received { term: 80 index: 84 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:17.671973 10397 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 81 FOLLOWER]: Leader election vote request: Denying vote to candidate bd38b0e96f264071a69be73b6b4f14c1 in current term 81: Already voted for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in this term.
I20260204 09:11:17.672093 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 81 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:17.672191 10543 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 81 FOLLOWER]: Leader election lost for term 81. Reason: could not achieve majority
I20260204 09:11:17.672503 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 81 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 80. Current term is 81. Ops: []
I20260204 09:11:17.672667 10546 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 80.84, Next index: 85, Last known committed idx: 84, Time since last communication: 0.000s
I20260204 09:11:17.672765 10546 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 80 LEADER]: Stepping down as leader of term 80
I20260204 09:11:17.672792 10546 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 80 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:17.672847 10546 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 84, Committed index: 84, Last appended: 80.84, Last appended by leader: 84, Current term: 80, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:17.672928 10546 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 80 FOLLOWER]: Advancing to term 81
I20260204 09:11:17.764334 10548 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 81 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:17.764426 10548 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 81 FOLLOWER]: Advancing to term 82
I20260204 09:11:17.765280 10548 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 82 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:17.765637 10548 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 82 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:17.765664 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 82 candidate_status { last_received { term: 80 index: 84 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:17.765722 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 81 FOLLOWER]: Advancing to term 82
I20260204 09:11:17.766233 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 82 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 82.
I20260204 09:11:17.766423 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 82 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters:
I20260204 09:11:17.766521 10548 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 82 FOLLOWER]: Leader election won for term 82
I20260204 09:11:17.766564 10548 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 82 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:17.766613 10548 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 84, Committed index: 84, Last appended: 80.84, Last appended by leader: 84, Current term: 82, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:17.767125 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 80 to 82, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 82 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:17.768332 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 82 candidate_status { last_received { term: 80 index: 84 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:17.768428 10246 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 81 FOLLOWER]: Advancing to term 82
I20260204 09:11:17.769166 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 82 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 82.
I20260204 09:11:17.869601 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 82 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 80 index: 84. Preceding OpId from leader: term: 82 index: 85. (index mismatch)
I20260204 09:11:17.869882 10548 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 85, Last known committed idx: 84, Time since last communication: 0.000s
I20260204 09:11:17.870940 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 82 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 80 index: 84. Preceding OpId from leader: term: 82 index: 85. (index mismatch)
I20260204 09:11:17.871163 10552 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 85, Last known committed idx: 84, Time since last communication: 0.000s
I20260204 09:11:17.972290 10543 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 82 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:17.972391 10543 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 82 FOLLOWER]: Advancing to term 83
I20260204 09:11:17.973043 10543 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 83 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:17.973202 10543 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 83 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:17.973456 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 83 candidate_status { last_received { term: 82 index: 85 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:17.973454 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 83 candidate_status { last_received { term: 82 index: 85 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:17.973723 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 83 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:17.973804 10543 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 83 FOLLOWER]: Leader election lost for term 83. Reason: could not achieve majority
I20260204 09:11:17.978610 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 83 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 82. Current term is 83. Ops: []
I20260204 09:11:17.978832 10548 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 82.85, Next index: 86, Last known committed idx: 85, Time since last communication: 0.000s
I20260204 09:11:17.978938 10548 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 82 LEADER]: Stepping down as leader of term 82
I20260204 09:11:17.978971 10548 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 82 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:17.979029 10548 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 85, Committed index: 85, Last appended: 82.85, Last appended by leader: 85, Current term: 82, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:17.979104 10548 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 82 FOLLOWER]: Advancing to term 83
I20260204 09:11:17.979307 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:18.053782 10546 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 82 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:18.053882 10546 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 82 FOLLOWER]: Advancing to term 83
I20260204 09:11:18.054536 10546 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 83 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:18.054702 10546 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 83 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:18.054921 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 83 candidate_status { last_received { term: 82 index: 85 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:18.054948 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 83 candidate_status { last_received { term: 82 index: 85 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:18.055071 10322 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 83 FOLLOWER]: Leader election vote request: Denying vote to candidate 11502cf05241427fb9853e628add7746 in current term 83: Already voted for candidate bd38b0e96f264071a69be73b6b4f14c1 in this term.
I20260204 09:11:18.055647 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 83 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 83.
I20260204 09:11:18.055831 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 83 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:18.055936 10546 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 83 FOLLOWER]: Leader election won for term 83
I20260204 09:11:18.055997 10546 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 83 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:18.056056 10546 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 85, Committed index: 85, Last appended: 82.85, Last appended by leader: 85, Current term: 83, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:18.056532 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 82 to 83, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 83 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:18.089195 10543 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 83 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:18.089264 10543 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 83 FOLLOWER]: Advancing to term 84
I20260204 09:11:18.089931 10543 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 84 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:18.090075 10543 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 84 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:18.090282 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 84 candidate_status { last_received { term: 82 index: 85 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:18.090296 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 84 candidate_status { last_received { term: 82 index: 85 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:18.090368 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 83 FOLLOWER]: Advancing to term 84
I20260204 09:11:18.090924 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 84 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 84.
I20260204 09:11:18.091066 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 84 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:18.091149 10543 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 84 FOLLOWER]: Leader election won for term 84
I20260204 09:11:18.091245 10543 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 84 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:18.091285 10543 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 85, Committed index: 85, Last appended: 82.85, Last appended by leader: 85, Current term: 84, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:18.091706 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 83 to 84, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 84 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:18.154032 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 84 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 83. Current term is 84. Ops: []
I20260204 09:11:18.154371 10546 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 86, Last known committed idx: 85, Time since last communication: 0.000s
I20260204 09:11:18.154492 10546 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 83 LEADER]: Stepping down as leader of term 83
I20260204 09:11:18.154526 10546 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 83 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:18.154580 10546 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 85, Committed index: 85, Last appended: 83.86, Last appended by leader: 86, Current term: 83, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:18.154649 10546 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 83 FOLLOWER]: Advancing to term 84
I20260204 09:11:18.168982 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 84 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 82 index: 85. Preceding OpId from leader: term: 84 index: 86. (index mismatch)
I20260204 09:11:18.169220 10543 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 86, Last known committed idx: 85, Time since last communication: 0.000s
I20260204 09:11:18.170233 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 84 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 83 index: 86. Preceding OpId from leader: term: 84 index: 86. (term mismatch)
I20260204 09:11:18.170284 10246 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting all ops after (but not including) 85
I20260204 09:11:18.170303 10246 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting uncommitted NO_OP operation due to leader change: 83.86
I20260204 09:11:18.170320 10246 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 84 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:18.170490 10543 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 86, Last known committed idx: 85, Time since last communication: 0.000s
I20260204 09:11:18.270915 10548 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 84 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:18.271015 10548 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 84 FOLLOWER]: Advancing to term 85
I20260204 09:11:18.271719 10548 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 85 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:18.271894 10548 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 85 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:18.272128 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 85 candidate_status { last_received { term: 84 index: 86 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:18.272128 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 85 candidate_status { last_received { term: 84 index: 86 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:18.272241 10246 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 84 FOLLOWER]: Advancing to term 85
I20260204 09:11:18.272804 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 85 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 85.
I20260204 09:11:18.272966 10362 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 85 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:18.273051 10548 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 85 FOLLOWER]: Leader election won for term 85
I20260204 09:11:18.273108 10548 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 85 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:18.273162 10548 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 86, Committed index: 86, Last appended: 84.86, Last appended by leader: 86, Current term: 85, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:18.273612 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 84 to 85, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 85 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:18.284293 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 85 LEADER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 84. Current term is 85. Ops: []
I20260204 09:11:18.284515 10543 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 84.86, Next index: 87, Last known committed idx: 86, Time since last communication: 0.000s
I20260204 09:11:18.284612 10543 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer 8b12f9075d9d4ffa9fd711322da0c4d2 log is divergent from this leader: its last log entry 85.87 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 86
I20260204 09:11:18.284667 10553 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 84 LEADER]: Stepping down as leader of term 84
I20260204 09:11:18.284718 10553 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 84 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:18.284781 10553 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 86, Committed index: 86, Last appended: 84.86, Last appended by leader: 86, Current term: 84, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:18.284868 10553 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 84 FOLLOWER]: Advancing to term 85
I20260204 09:11:18.376189 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 85 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 84 index: 86. Preceding OpId from leader: term: 85 index: 87. (index mismatch)
I20260204 09:11:18.376451 10548 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 87, Last known committed idx: 86, Time since last communication: 0.000s
I20260204 09:11:18.377498 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 85 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 84 index: 86. Preceding OpId from leader: term: 85 index: 87. (index mismatch)
I20260204 09:11:18.377743 10552 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 87, Last known committed idx: 86, Time since last communication: 0.000s
I20260204 09:11:18.598553 10553 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 85 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:18.598698 10553 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 85 FOLLOWER]: Advancing to term 86
I20260204 09:11:18.599421 10553 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 86 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:18.599586 10553 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 86 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:18.599787 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 86 candidate_status { last_received { term: 85 index: 87 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:18.599787 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 86 candidate_status { last_received { term: 85 index: 87 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:18.600082 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 86 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:18.600178 10553 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 86 FOLLOWER]: Leader election lost for term 86. Reason: could not achieve majority
I20260204 09:11:18.617926 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 86 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 85. Current term is 86. Ops: []
I20260204 09:11:18.618222 10547 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 85.87, Next index: 88, Last known committed idx: 87, Time since last communication: 0.000s
I20260204 09:11:18.618377 10548 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 85 LEADER]: Stepping down as leader of term 85
I20260204 09:11:18.618417 10548 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 85 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:18.618474 10548 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 87, Committed index: 87, Last appended: 85.87, Last appended by leader: 87, Current term: 85, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:18.618564 10548 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 85 FOLLOWER]: Advancing to term 86
I20260204 09:11:18.657241 10546 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 85 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:18.657330 10546 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 85 FOLLOWER]: Advancing to term 86
I20260204 09:11:18.657974 10546 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 86 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:18.658134 10546 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 86 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:18.658319 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 86 candidate_status { last_received { term: 85 index: 87 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:18.658349 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 86 candidate_status { last_received { term: 85 index: 87 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:18.658432 10322 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 86 FOLLOWER]: Leader election vote request: Denying vote to candidate 11502cf05241427fb9853e628add7746 in current term 86: Already voted for candidate bd38b0e96f264071a69be73b6b4f14c1 in this term.
I20260204 09:11:18.658915 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 86 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 86.
I20260204 09:11:18.659091 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 86 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:18.659170 10546 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 86 FOLLOWER]: Leader election won for term 86
I20260204 09:11:18.659271 10546 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 86 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:18.659318 10546 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 87, Committed index: 87, Last appended: 85.87, Last appended by leader: 87, Current term: 86, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:18.659767 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 85 to 86, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 86 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:18.748894 10553 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 86 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:18.748991 10553 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 86 FOLLOWER]: Advancing to term 87
I20260204 09:11:18.749699 10553 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 87 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:18.749862 10553 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 87 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:18.750102 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 87 candidate_status { last_received { term: 85 index: 87 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:18.750102 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 87 candidate_status { last_received { term: 85 index: 87 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:18.750252 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 86 FOLLOWER]: Advancing to term 87
I20260204 09:11:18.750769 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 87 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 87.
I20260204 09:11:18.750919 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 87 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:18.751019 10553 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 87 FOLLOWER]: Leader election won for term 87
I20260204 09:11:18.751071 10553 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 87 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:18.751111 10553 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 87, Committed index: 87, Last appended: 85.87, Last appended by leader: 87, Current term: 87, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:18.751546 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 86 to 87, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 87 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:18.763743 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 87 LEADER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 86. Current term is 87. Ops: []
I20260204 09:11:18.763938 10546 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 0.0, Next index: 88, Last known committed idx: 87, Time since last communication: 0.000s
I20260204 09:11:18.764012 10546 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer bd38b0e96f264071a69be73b6b4f14c1 log is divergent from this leader: its last log entry 87.88 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 87
I20260204 09:11:18.764051 10554 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 86 LEADER]: Stepping down as leader of term 86
I20260204 09:11:18.764092 10554 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 86 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:18.764147 10554 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 87, Committed index: 87, Last appended: 86.88, Last appended by leader: 88, Current term: 86, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:18.764222 10554 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 86 FOLLOWER]: Advancing to term 87
I20260204 09:11:18.837962 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 87 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 86 index: 88. Preceding OpId from leader: term: 87 index: 88. (term mismatch)
I20260204 09:11:18.838040 10246 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting all ops after (but not including) 87
I20260204 09:11:18.838053 10246 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting uncommitted NO_OP operation due to leader change: 86.88
I20260204 09:11:18.838066 10246 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 87 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:18.838261 10553 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 88, Last known committed idx: 87, Time since last communication: 0.000s
I20260204 09:11:18.839217 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 87 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 85 index: 87. Preceding OpId from leader: term: 87 index: 88. (index mismatch)
I20260204 09:11:18.839411 10543 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 88, Last known committed idx: 87, Time since last communication: 0.000s
I20260204 09:11:18.979514 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:19.024230 10548 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 87 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:19.024325 10548 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 87 FOLLOWER]: Advancing to term 88
I20260204 09:11:19.024940 10548 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 88 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:19.025082 10548 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 88 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:19.025285 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 88 candidate_status { last_received { term: 87 index: 88 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:19.025287 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 88 candidate_status { last_received { term: 87 index: 88 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:19.025534 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 88 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:19.025650 10548 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 88 FOLLOWER]: Leader election lost for term 88. Reason: could not achieve majority
I20260204 09:11:19.047946 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 88 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 87. Current term is 88. Ops: []
I20260204 09:11:19.048238 10555 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 87.88, Next index: 89, Last known committed idx: 88, Time since last communication: 0.000s
I20260204 09:11:19.048372 10553 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 87 LEADER]: Stepping down as leader of term 87
I20260204 09:11:19.048442 10553 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 87 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:19.048516 10553 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 88, Committed index: 88, Last appended: 87.88, Last appended by leader: 88, Current term: 87, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:19.048611 10553 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 87 FOLLOWER]: Advancing to term 88
I20260204 09:11:19.048697 10554 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 87 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:19.048750 10554 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 87 FOLLOWER]: Advancing to term 88
I20260204 09:11:19.049324 10554 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 88 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:19.049468 10554 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 88 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:19.049618 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 88 candidate_status { last_received { term: 87 index: 88 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:19.049619 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 88 candidate_status { last_received { term: 87 index: 88 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:19.049727 10397 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 88 FOLLOWER]: Leader election vote request: Denying vote to candidate 11502cf05241427fb9853e628add7746 in current term 88: Already voted for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in this term.
I20260204 09:11:19.050225 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 88 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 88.
I20260204 09:11:19.050379 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 88 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:19.050462 10554 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 88 FOLLOWER]: Leader election won for term 88
I20260204 09:11:19.050514 10554 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 88 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:19.050549 10554 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 88, Committed index: 88, Last appended: 87.88, Last appended by leader: 88, Current term: 88, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:19.050959 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 87 to 88, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 88 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:19.131453 10548 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 88 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:19.131559 10548 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 88 FOLLOWER]: Advancing to term 89
I20260204 09:11:19.132243 10548 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 89 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:19.132421 10548 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 89 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:19.132625 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 89 candidate_status { last_received { term: 87 index: 88 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:19.132630 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 89 candidate_status { last_received { term: 87 index: 88 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:19.132812 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 88 FOLLOWER]: Advancing to term 89
I20260204 09:11:19.133391 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 89 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 89.
I20260204 09:11:19.133548 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 89 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:19.133652 10548 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 89 FOLLOWER]: Leader election won for term 89
I20260204 09:11:19.133747 10548 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 89 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:19.133790 10548 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 88, Committed index: 88, Last appended: 87.88, Last appended by leader: 88, Current term: 89, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:19.134246 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 88 to 89, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 89 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:19.147272 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 89 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 88. Current term is 89. Ops: []
I20260204 09:11:19.147502 10554 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 0.0, Next index: 89, Last known committed idx: 88, Time since last communication: 0.000s
I20260204 09:11:19.147603 10554 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 88 LEADER]: Stepping down as leader of term 88
I20260204 09:11:19.147629 10554 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 88 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:19.147682 10554 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 88, Committed index: 88, Last appended: 88.89, Last appended by leader: 89, Current term: 88, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:19.147764 10554 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 88 FOLLOWER]: Advancing to term 89
I20260204 09:11:19.212565 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 89 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 87 index: 88. Preceding OpId from leader: term: 89 index: 89. (index mismatch)
I20260204 09:11:19.212826 10548 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 89, Last known committed idx: 88, Time since last communication: 0.000s
I20260204 09:11:19.213765 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 89 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 88 index: 89. Preceding OpId from leader: term: 89 index: 89. (term mismatch)
I20260204 09:11:19.213822 10246 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting all ops after (but not including) 88
I20260204 09:11:19.213840 10246 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting uncommitted NO_OP operation due to leader change: 88.89
I20260204 09:11:19.213855 10246 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 89 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:19.214017 10557 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 89, Last known committed idx: 88, Time since last communication: 0.000s
I20260204 09:11:19.396270 10553 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 89 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:19.396365 10553 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 89 FOLLOWER]: Advancing to term 90
I20260204 09:11:19.397015 10553 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 90 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:19.397145 10553 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 90 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:19.397347 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 90 candidate_status { last_received { term: 89 index: 89 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:19.397390 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 90 candidate_status { last_received { term: 89 index: 89 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:19.397598 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 90 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:19.397686 10553 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 90 FOLLOWER]: Leader election lost for term 90. Reason: could not achieve majority
I20260204 09:11:19.399272 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 90 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 89. Current term is 90. Ops: []
I20260204 09:11:19.399449 10548 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 89.89, Next index: 90, Last known committed idx: 89, Time since last communication: 0.000s
I20260204 09:11:19.399544 10548 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 89 LEADER]: Stepping down as leader of term 89
I20260204 09:11:19.399575 10548 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 89 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:19.399627 10548 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 89, Committed index: 89, Last appended: 89.89, Last appended by leader: 89, Current term: 89, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:19.399696 10548 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 89 FOLLOWER]: Advancing to term 90
I20260204 09:11:19.407168 10554 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 89 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:19.407222 10554 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 89 FOLLOWER]: Advancing to term 90
I20260204 09:11:19.407728 10554 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 90 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:19.407846 10554 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 90 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:19.408015 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 90 candidate_status { last_received { term: 89 index: 89 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:19.408013 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 90 candidate_status { last_received { term: 89 index: 89 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:19.408105 10322 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 90 FOLLOWER]: Leader election vote request: Denying vote to candidate 11502cf05241427fb9853e628add7746 in current term 90: Already voted for candidate bd38b0e96f264071a69be73b6b4f14c1 in this term.
I20260204 09:11:19.408556 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 90 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 90.
I20260204 09:11:19.408716 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 90 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:19.408800 10554 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 90 FOLLOWER]: Leader election won for term 90
I20260204 09:11:19.408854 10554 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 90 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:19.408913 10554 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 89, Committed index: 89, Last appended: 89.89, Last appended by leader: 89, Current term: 90, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:19.409348 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 89 to 90, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 90 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:19.498719 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 90 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 89 index: 89. Preceding OpId from leader: term: 90 index: 90. (index mismatch)
I20260204 09:11:19.498989 10554 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 90, Last known committed idx: 89, Time since last communication: 0.000s
I20260204 09:11:19.499501 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 90 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 89 index: 89. Preceding OpId from leader: term: 90 index: 90. (index mismatch)
I20260204 09:11:19.499665 10554 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 90, Last known committed idx: 89, Time since last communication: 0.000s
I20260204 09:11:19.700937 10553 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 90 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:19.701030 10553 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 90 FOLLOWER]: Advancing to term 91
I20260204 09:11:19.701668 10553 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 91 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:19.701824 10553 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 91 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:19.702055 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 91 candidate_status { last_received { term: 90 index: 90 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:19.702055 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 91 candidate_status { last_received { term: 90 index: 90 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:19.702332 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 91 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:19.702409 10553 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 91 FOLLOWER]: Leader election lost for term 91. Reason: could not achieve majority
I20260204 09:11:19.711724 10548 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 90 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:19.711784 10548 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 90 FOLLOWER]: Advancing to term 91
I20260204 09:11:19.712343 10548 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 91 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:19.712471 10548 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 91 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:19.712684 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 91 candidate_status { last_received { term: 90 index: 90 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:19.712700 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 91 candidate_status { last_received { term: 90 index: 90 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:19.712776 10322 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 91 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in current term 91: Already voted for candidate bd38b0e96f264071a69be73b6b4f14c1 in this term.
I20260204 09:11:19.712909 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 91 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:19.712998 10548 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 91 FOLLOWER]: Leader election lost for term 91. Reason: could not achieve majority
I20260204 09:11:19.717689 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 91 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 90. Current term is 91. Ops: []
I20260204 09:11:19.717892 10546 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 90.90, Next index: 91, Last known committed idx: 90, Time since last communication: 0.000s
I20260204 09:11:19.717990 10546 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 90 LEADER]: Stepping down as leader of term 90
I20260204 09:11:19.718014 10546 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 90 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:19.718067 10546 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 90, Committed index: 90, Last appended: 90.90, Last appended by leader: 90, Current term: 90, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:19.718132 10546 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 90 FOLLOWER]: Advancing to term 91
I20260204 09:11:19.835206 10553 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 91 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:19.835318 10553 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 91 FOLLOWER]: Advancing to term 92
I20260204 09:11:19.836032 10553 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 92 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:19.836203 10553 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 92 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:19.836329 10548 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 91 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:19.836365 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 92 candidate_status { last_received { term: 90 index: 90 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:19.836380 10548 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 91 FOLLOWER]: Advancing to term 92
I20260204 09:11:19.836421 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 92 candidate_status { last_received { term: 90 index: 90 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:19.836551 10246 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 91 FOLLOWER]: Advancing to term 92
I20260204 09:11:19.837036 10548 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 92 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:19.837102 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 92 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 92.
I20260204 09:11:19.837145 10397 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 92 FOLLOWER]: Leader election vote request: Denying vote to candidate bd38b0e96f264071a69be73b6b4f14c1 in current term 92: Already voted for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in this term.
I20260204 09:11:19.837270 10548 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 92 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:19.837273 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 92 candidate_status { last_received { term: 90 index: 90 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:19.837332 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 92 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:19.837385 10246 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 92 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in current term 92: Already voted for candidate bd38b0e96f264071a69be73b6b4f14c1 in this term.
I20260204 09:11:19.837402 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 92 candidate_status { last_received { term: 90 index: 90 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:19.837443 10553 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 92 FOLLOWER]: Leader election won for term 92
I20260204 09:11:19.837527 10553 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 92 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:19.837576 10553 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 90, Committed index: 90, Last appended: 90.90, Last appended by leader: 90, Current term: 92, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:19.837882 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 92 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:19.837999 10548 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 92 FOLLOWER]: Leader election lost for term 92. Reason: could not achieve majority
I20260204 09:11:19.838040 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 90 to 92, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 92 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:19.923405 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 92 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 90 index: 90. Preceding OpId from leader: term: 92 index: 91. (index mismatch)
I20260204 09:11:19.923671 10553 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 91, Last known committed idx: 90, Time since last communication: 0.000s
I20260204 09:11:19.924679 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 92 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 90 index: 90. Preceding OpId from leader: term: 92 index: 91. (index mismatch)
I20260204 09:11:19.924906 10553 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 91, Last known committed idx: 90, Time since last communication: 0.000s
I20260204 09:11:19.979800 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:20.024678 10546 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 92 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:20.024778 10546 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 92 FOLLOWER]: Advancing to term 93
I20260204 09:11:20.025422 10546 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 93 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:20.025584 10546 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 93 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:20.025543 10560 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 92 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:20.025636 10560 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 92 FOLLOWER]: Advancing to term 93
I20260204 09:11:20.025753 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 93 candidate_status { last_received { term: 92 index: 91 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:20.025875 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 93 candidate_status { last_received { term: 92 index: 91 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:20.026355 10560 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 93 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:20.026464 10397 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 93 FOLLOWER]: Leader election vote request: Denying vote to candidate 11502cf05241427fb9853e628add7746 in current term 93: Already voted for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in this term.
I20260204 09:11:20.026512 10560 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 93 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:20.026620 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 93 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11502cf05241427fb9853e628add7746; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:20.026659 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 93 candidate_status { last_received { term: 92 index: 91 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:20.026633 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 93 candidate_status { last_received { term: 92 index: 91 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:20.026736 10246 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 93 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in current term 93: Already voted for candidate 11502cf05241427fb9853e628add7746 in this term.
I20260204 09:11:20.026762 10546 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 93 FOLLOWER]: Leader election lost for term 93. Reason: could not achieve majority
I20260204 09:11:20.026870 10362 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 93 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:20.026945 10560 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 93 FOLLOWER]: Leader election lost for term 93. Reason: could not achieve majority
I20260204 09:11:20.036609 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 93 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 92. Current term is 93. Ops: []
I20260204 09:11:20.036816 10561 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 92.91, Next index: 92, Last known committed idx: 91, Time since last communication: 0.000s
I20260204 09:11:20.036906 10561 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 92 LEADER]: Stepping down as leader of term 92
I20260204 09:11:20.036931 10561 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 92 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:20.036989 10561 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 91, Committed index: 91, Last appended: 92.91, Last appended by leader: 91, Current term: 92, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:20.037070 10561 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 92 FOLLOWER]: Advancing to term 93
I20260204 09:11:20.139134 10546 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 93 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:20.139246 10546 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 93 FOLLOWER]: Advancing to term 94
I20260204 09:11:20.139942 10546 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 94 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:20.140131 10546 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 94 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:20.140326 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 94 candidate_status { last_received { term: 92 index: 91 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:20.140326 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 94 candidate_status { last_received { term: 92 index: 91 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:20.140434 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 93 FOLLOWER]: Advancing to term 94
I20260204 09:11:20.140440 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 93 FOLLOWER]: Advancing to term 94
I20260204 09:11:20.141125 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 94 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 94.
I20260204 09:11:20.141125 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 94 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 94.
I20260204 09:11:20.141345 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 94 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters:
I20260204 09:11:20.141470 10546 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 94 FOLLOWER]: Leader election won for term 94
I20260204 09:11:20.141535 10546 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 94 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:20.141574 10546 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 91, Committed index: 91, Last appended: 92.91, Last appended by leader: 91, Current term: 94, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:20.142021 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 92 to 94, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 94 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:20.240399 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 94 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 92 index: 91. Preceding OpId from leader: term: 94 index: 92. (index mismatch)
I20260204 09:11:20.240657 10546 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 92, Last known committed idx: 91, Time since last communication: 0.000s
I20260204 09:11:20.241526 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 94 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 92 index: 91. Preceding OpId from leader: term: 94 index: 92. (index mismatch)
I20260204 09:11:20.241725 10562 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 92, Last known committed idx: 91, Time since last communication: 0.000s
I20260204 09:11:20.348549 10548 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 94 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:20.348641 10548 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 94 FOLLOWER]: Advancing to term 95
I20260204 09:11:20.349278 10548 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 95 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:20.349476 10548 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 95 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:20.349682 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 95 candidate_status { last_received { term: 94 index: 92 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:20.349696 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 95 candidate_status { last_received { term: 94 index: 92 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:20.349922 10362 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 95 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:20.350023 10548 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 95 FOLLOWER]: Leader election lost for term 95. Reason: could not achieve majority
I20260204 09:11:20.351082 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 95 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 94. Current term is 95. Ops: []
I20260204 09:11:20.351266 10558 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 94.92, Next index: 93, Last known committed idx: 92, Time since last communication: 0.000s
I20260204 09:11:20.351356 10558 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 94 LEADER]: Stepping down as leader of term 94
I20260204 09:11:20.351382 10558 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 94 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:20.351424 10558 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 92, Committed index: 92, Last appended: 94.92, Last appended by leader: 92, Current term: 94, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:20.351509 10558 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 94 FOLLOWER]: Advancing to term 95
I20260204 09:11:20.417161 10561 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 94 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:20.417258 10561 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 94 FOLLOWER]: Advancing to term 95
I20260204 09:11:20.417937 10561 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 95 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:20.418109 10561 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 95 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:20.418355 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 95 candidate_status { last_received { term: 94 index: 92 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:20.418394 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 95 candidate_status { last_received { term: 94 index: 92 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:20.418478 10397 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 95 FOLLOWER]: Leader election vote request: Denying vote to candidate bd38b0e96f264071a69be73b6b4f14c1 in current term 95: Already voted for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in this term.
I20260204 09:11:20.418984 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 95 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 95.
I20260204 09:11:20.419162 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 95 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:20.419242 10561 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 95 FOLLOWER]: Leader election won for term 95
I20260204 09:11:20.419288 10561 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 95 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:20.419328 10561 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 92, Committed index: 92, Last appended: 94.92, Last appended by leader: 92, Current term: 95, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:20.419724 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 94 to 95, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 95 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:20.458804 10548 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 95 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:20.458886 10548 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 95 FOLLOWER]: Advancing to term 96
I20260204 09:11:20.459496 10548 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 96 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:20.459651 10548 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 96 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:20.459882 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 96 candidate_status { last_received { term: 94 index: 92 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:20.459888 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 96 candidate_status { last_received { term: 94 index: 92 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:20.459981 10246 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 95 FOLLOWER]: Advancing to term 96
I20260204 09:11:20.460520 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 96 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 96.
I20260204 09:11:20.460676 10362 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 96 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:20.460757 10548 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 96 FOLLOWER]: Leader election won for term 96
I20260204 09:11:20.460806 10548 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 96 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:20.460852 10548 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 92, Committed index: 92, Last appended: 94.92, Last appended by leader: 92, Current term: 96, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:20.461241 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 95 to 96, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 96 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:20.539031 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 96 LEADER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 95. Current term is 96. Ops: []
I20260204 09:11:20.539271 10561 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 93, Last known committed idx: 92, Time since last communication: 0.000s
I20260204 09:11:20.539377 10561 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer 8b12f9075d9d4ffa9fd711322da0c4d2 log is divergent from this leader: its last log entry 96.93 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 92
I20260204 09:11:20.539412 10559 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 95 LEADER]: Stepping down as leader of term 95
I20260204 09:11:20.539458 10559 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 95 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:20.539513 10559 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 92, Committed index: 92, Last appended: 95.93, Last appended by leader: 93, Current term: 95, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:20.539600 10559 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 95 FOLLOWER]: Advancing to term 96
I20260204 09:11:20.562669 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 96 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 95 index: 93. Preceding OpId from leader: term: 96 index: 93. (term mismatch)
I20260204 09:11:20.562737 10322 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Aborting all ops after (but not including) 92
I20260204 09:11:20.562750 10322 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Aborting uncommitted NO_OP operation due to leader change: 95.93
I20260204 09:11:20.562763 10322 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 96 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:20.562988 10548 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 93, Last known committed idx: 92, Time since last communication: 0.000s
I20260204 09:11:20.563964 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 96 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 94 index: 92. Preceding OpId from leader: term: 96 index: 93. (index mismatch)
I20260204 09:11:20.564136 10560 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 93, Last known committed idx: 92, Time since last communication: 0.000s
I20260204 09:11:20.866355 10559 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 96 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:20.866446 10559 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 96 FOLLOWER]: Advancing to term 97
I20260204 09:11:20.867126 10559 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 97 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:20.867281 10559 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 97 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:20.867484 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 97 candidate_status { last_received { term: 96 index: 93 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:20.867492 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 97 candidate_status { last_received { term: 96 index: 93 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:20.867717 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 97 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:20.867800 10559 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 97 FOLLOWER]: Leader election lost for term 97. Reason: could not achieve majority
I20260204 09:11:20.890240 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 97 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 96. Current term is 97. Ops: []
I20260204 09:11:20.890496 10563 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 96.93, Next index: 94, Last known committed idx: 93, Time since last communication: 0.000s
I20260204 09:11:20.890614 10563 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 96 LEADER]: Stepping down as leader of term 96
I20260204 09:11:20.890640 10563 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 96 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:20.890703 10563 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 93, Committed index: 93, Last appended: 96.93, Last appended by leader: 93, Current term: 96, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:20.890789 10563 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 96 FOLLOWER]: Advancing to term 97
I20260204 09:11:20.926774 10558 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 96 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:20.926878 10558 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 96 FOLLOWER]: Advancing to term 97
I20260204 09:11:20.927546 10558 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 97 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:20.927708 10558 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 97 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:20.927901 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 97 candidate_status { last_received { term: 96 index: 93 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:20.927911 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 97 candidate_status { last_received { term: 96 index: 93 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:20.928023 10322 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 97 FOLLOWER]: Leader election vote request: Denying vote to candidate 11502cf05241427fb9853e628add7746 in current term 97: Already voted for candidate bd38b0e96f264071a69be73b6b4f14c1 in this term.
I20260204 09:11:20.928511 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 97 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 97.
I20260204 09:11:20.928661 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 97 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:20.928738 10558 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 97 FOLLOWER]: Leader election won for term 97
I20260204 09:11:20.928859 10558 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 97 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:20.928903 10558 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 93, Committed index: 93, Last appended: 96.93, Last appended by leader: 93, Current term: 97, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:20.929299 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 96 to 97, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 97 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:20.974185 10559 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 97 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:20.974282 10559 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 97 FOLLOWER]: Advancing to term 98
I20260204 09:11:20.974918 10559 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 98 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:20.975064 10559 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 98 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:20.975286 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 98 candidate_status { last_received { term: 96 index: 93 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:20.975360 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 97 FOLLOWER]: Advancing to term 98
I20260204 09:11:20.975310 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 98 candidate_status { last_received { term: 96 index: 93 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:20.975876 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 98 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 98.
I20260204 09:11:20.976038 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 98 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:20.976125 10559 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 98 FOLLOWER]: Leader election won for term 98
I20260204 09:11:20.976178 10559 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 98 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:20.976248 10559 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 93, Committed index: 93, Last appended: 96.93, Last appended by leader: 93, Current term: 98, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:20.976650 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 97 to 98, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 98 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:20.980031 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:21.017666 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 98 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 97. Current term is 98. Ops: []
I20260204 09:11:21.017908 10558 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 94, Last known committed idx: 93, Time since last communication: 0.000s
I20260204 09:11:21.018018 10558 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 97 LEADER]: Stepping down as leader of term 97
I20260204 09:11:21.018049 10558 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 97 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:21.018108 10558 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 93, Committed index: 93, Last appended: 97.94, Last appended by leader: 94, Current term: 97, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:21.018179 10558 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 97 FOLLOWER]: Advancing to term 98
I20260204 09:11:21.055987 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 98 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 96 index: 93. Preceding OpId from leader: term: 98 index: 94. (index mismatch)
I20260204 09:11:21.056243 10559 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 94, Last known committed idx: 93, Time since last communication: 0.000s
I20260204 09:11:21.057165 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 98 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 97 index: 94. Preceding OpId from leader: term: 98 index: 94. (term mismatch)
I20260204 09:11:21.057215 10246 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting all ops after (but not including) 93
I20260204 09:11:21.057318 10246 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting uncommitted NO_OP operation due to leader change: 97.94
I20260204 09:11:21.057336 10246 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 98 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:21.057610 10561 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 94, Last known committed idx: 93, Time since last communication: 0.000s
I20260204 09:11:21.157516 10563 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 98 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:21.157611 10563 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 98 FOLLOWER]: Advancing to term 99
I20260204 09:11:21.158296 10563 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 99 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:21.158473 10563 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 99 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:21.158666 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 99 candidate_status { last_received { term: 98 index: 94 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:21.158689 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 99 candidate_status { last_received { term: 98 index: 94 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:21.158759 10246 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 98 FOLLOWER]: Advancing to term 99
I20260204 09:11:21.159296 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 99 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 99.
I20260204 09:11:21.159461 10362 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 99 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:21.159545 10563 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 99 FOLLOWER]: Leader election won for term 99
I20260204 09:11:21.159598 10563 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 99 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:21.159658 10563 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 94, Committed index: 94, Last appended: 98.94, Last appended by leader: 94, Current term: 99, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:21.160086 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 98 to 99, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 99 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:21.179291 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 99 LEADER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 98. Current term is 99. Ops: []
I20260204 09:11:21.179498 10561 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 98.94, Next index: 95, Last known committed idx: 94, Time since last communication: 0.000s
I20260204 09:11:21.179587 10561 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer 8b12f9075d9d4ffa9fd711322da0c4d2 log is divergent from this leader: its last log entry 99.95 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 94
I20260204 09:11:21.179622 10559 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 98 LEADER]: Stepping down as leader of term 98
I20260204 09:11:21.179659 10559 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 98 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:21.179714 10559 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 94, Committed index: 94, Last appended: 98.94, Last appended by leader: 94, Current term: 98, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:21.179795 10559 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 98 FOLLOWER]: Advancing to term 99
I20260204 09:11:21.253540 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 99 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 98 index: 94. Preceding OpId from leader: term: 99 index: 95. (index mismatch)
I20260204 09:11:21.253839 10563 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 95, Last known committed idx: 94, Time since last communication: 0.000s
I20260204 09:11:21.255062 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 99 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 98 index: 94. Preceding OpId from leader: term: 99 index: 95. (index mismatch)
I20260204 09:11:21.255223 10548 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 95, Last known committed idx: 94, Time since last communication: 0.000s
I20260204 09:11:21.356155 10558 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 99 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:21.356256 10558 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 99 FOLLOWER]: Advancing to term 100
I20260204 09:11:21.356885 10558 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 100 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:21.357056 10558 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 100 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:21.357270 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 100 candidate_status { last_received { term: 99 index: 95 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:21.357283 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 100 candidate_status { last_received { term: 99 index: 95 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:21.357347 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 99 FOLLOWER]: Advancing to term 100
I20260204 09:11:21.357939 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 100 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 100.
I20260204 09:11:21.358108 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 100 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:21.358201 10558 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 100 FOLLOWER]: Leader election won for term 100
I20260204 09:11:21.358248 10558 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 100 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:21.358291 10558 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 95, Committed index: 95, Last appended: 99.95, Last appended by leader: 95, Current term: 100, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:21.358728 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 99 to 100, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 100 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:21.360306 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 100 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 99. Current term is 100. Ops: []
I20260204 09:11:21.360476 10548 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 99.95, Next index: 96, Last known committed idx: 95, Time since last communication: 0.000s
I20260204 09:11:21.360539 10548 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 99 LEADER]: Stepping down as leader of term 99
I20260204 09:11:21.360567 10548 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 99 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:21.360616 10548 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 95, Committed index: 95, Last appended: 99.95, Last appended by leader: 95, Current term: 99, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:21.360685 10548 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 99 FOLLOWER]: Advancing to term 100
I20260204 09:11:21.462224 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 100 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 99 index: 95. Preceding OpId from leader: term: 100 index: 96. (index mismatch)
I20260204 09:11:21.462525 10558 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 96, Last known committed idx: 95, Time since last communication: 0.000s
I20260204 09:11:21.463007 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 100 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 99 index: 95. Preceding OpId from leader: term: 100 index: 96. (index mismatch)
I20260204 09:11:21.463251 10558 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 96, Last known committed idx: 95, Time since last communication: 0.000s
I20260204 09:11:21.660588 10548 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 100 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:21.660702 10548 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 100 FOLLOWER]: Advancing to term 101
I20260204 09:11:21.661346 10548 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 101 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:21.661543 10548 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 101 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:21.661721 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 101 candidate_status { last_received { term: 100 index: 96 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:21.661741 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 101 candidate_status { last_received { term: 100 index: 96 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:21.661955 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 101 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:21.662037 10548 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 101 FOLLOWER]: Leader election lost for term 101. Reason: could not achieve majority
I20260204 09:11:21.663308 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 101 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 100. Current term is 101. Ops: []
I20260204 09:11:21.663501 10566 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 100.96, Next index: 97, Last known committed idx: 96, Time since last communication: 0.000s
I20260204 09:11:21.663604 10564 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 100 LEADER]: Stepping down as leader of term 100
I20260204 09:11:21.663651 10564 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 100 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:21.663717 10564 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 96, Committed index: 96, Last appended: 100.96, Last appended by leader: 96, Current term: 100, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:21.663813 10564 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 100 FOLLOWER]: Advancing to term 101
I20260204 09:11:21.725996 10559 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 100 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:21.726092 10559 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 100 FOLLOWER]: Advancing to term 101
I20260204 09:11:21.726717 10559 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 101 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:21.726850 10559 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 101 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:21.727073 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 101 candidate_status { last_received { term: 100 index: 96 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:21.727073 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 101 candidate_status { last_received { term: 100 index: 96 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:21.727205 10397 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 101 FOLLOWER]: Leader election vote request: Denying vote to candidate bd38b0e96f264071a69be73b6b4f14c1 in current term 101: Already voted for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in this term.
I20260204 09:11:21.727747 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 101 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 101.
I20260204 09:11:21.727926 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 101 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:21.728006 10559 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 101 FOLLOWER]: Leader election won for term 101
I20260204 09:11:21.728120 10559 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 101 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:21.728176 10559 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 96, Committed index: 96, Last appended: 100.96, Last appended by leader: 96, Current term: 101, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:21.728586 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 100 to 101, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 101 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:21.763383 10548 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 101 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:21.763478 10548 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 101 FOLLOWER]: Advancing to term 102
I20260204 09:11:21.764246 10548 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 102 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:21.764407 10548 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 102 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:21.764602 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 102 candidate_status { last_received { term: 100 index: 96 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:21.764722 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 102 candidate_status { last_received { term: 100 index: 96 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:21.764765 10246 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 101 FOLLOWER]: Advancing to term 102
I20260204 09:11:21.765259 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 102 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 102.
I20260204 09:11:21.765457 10362 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 102 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:21.765542 10548 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 102 FOLLOWER]: Leader election won for term 102
I20260204 09:11:21.765591 10548 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 102 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:21.765637 10548 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 96, Committed index: 96, Last appended: 100.96, Last appended by leader: 96, Current term: 102, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:21.766014 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 101 to 102, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 102 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:21.804881 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 102 LEADER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 101. Current term is 102. Ops: []
I20260204 09:11:21.805124 10559 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 97, Last known committed idx: 96, Time since last communication: 0.000s
I20260204 09:11:21.805229 10559 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer 8b12f9075d9d4ffa9fd711322da0c4d2 log is divergent from this leader: its last log entry 102.97 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 96
I20260204 09:11:21.805333 10567 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 101 LEADER]: Stepping down as leader of term 101
I20260204 09:11:21.805397 10567 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 101 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:21.805473 10567 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 96, Committed index: 96, Last appended: 101.97, Last appended by leader: 97, Current term: 101, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:21.805559 10567 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 101 FOLLOWER]: Advancing to term 102
I20260204 09:11:21.842370 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 102 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 101 index: 97. Preceding OpId from leader: term: 102 index: 97. (term mismatch)
I20260204 09:11:21.842459 10322 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Aborting all ops after (but not including) 96
I20260204 09:11:21.842471 10322 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Aborting uncommitted NO_OP operation due to leader change: 101.97
I20260204 09:11:21.842484 10322 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 102 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:21.842700 10548 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 97, Last known committed idx: 96, Time since last communication: 0.000s
I20260204 09:11:21.843582 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 102 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 100 index: 96. Preceding OpId from leader: term: 102 index: 97. (index mismatch)
I20260204 09:11:21.843796 10568 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 97, Last known committed idx: 96, Time since last communication: 0.000s
I20260204 09:11:21.980221 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:22.020407 10564 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 102 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:22.020501 10564 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 102 FOLLOWER]: Advancing to term 103
I20260204 09:11:22.021126 10564 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 103 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:22.021276 10564 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 103 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:22.021492 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 103 candidate_status { last_received { term: 102 index: 97 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:22.021494 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 103 candidate_status { last_received { term: 102 index: 97 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:22.021734 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 103 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11502cf05241427fb9853e628add7746; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:22.021827 10564 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 103 FOLLOWER]: Leader election lost for term 103. Reason: could not achieve majority
I20260204 09:11:22.027925 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 103 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 102. Current term is 103. Ops: []
I20260204 09:11:22.028106 10568 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 102.97, Next index: 98, Last known committed idx: 97, Time since last communication: 0.000s
I20260204 09:11:22.028231 10565 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 102 LEADER]: Stepping down as leader of term 102
I20260204 09:11:22.028278 10565 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 102 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:22.028338 10565 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 97, Committed index: 97, Last appended: 102.97, Last appended by leader: 97, Current term: 102, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:22.028414 10565 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 102 FOLLOWER]: Advancing to term 103
I20260204 09:11:22.030810 10567 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 102 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:22.030851 10567 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 102 FOLLOWER]: Advancing to term 103
I20260204 09:11:22.031345 10567 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 103 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:22.031458 10567 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 103 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:22.031601 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 103 candidate_status { last_received { term: 102 index: 97 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:22.031625 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 103 candidate_status { last_received { term: 102 index: 97 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:22.031680 10246 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 103 FOLLOWER]: Leader election vote request: Denying vote to candidate bd38b0e96f264071a69be73b6b4f14c1 in current term 103: Already voted for candidate 11502cf05241427fb9853e628add7746 in this term.
I20260204 09:11:22.032120 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 103 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 103.
I20260204 09:11:22.032261 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 103 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:22.032341 10567 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 103 FOLLOWER]: Leader election won for term 103
I20260204 09:11:22.032397 10567 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 103 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:22.032447 10567 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 97, Committed index: 97, Last appended: 102.97, Last appended by leader: 97, Current term: 103, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:22.032817 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 102 to 103, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 103 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:22.115257 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 103 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 102 index: 97. Preceding OpId from leader: term: 103 index: 98. (index mismatch)
I20260204 09:11:22.115510 10567 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 98, Last known committed idx: 97, Time since last communication: 0.000s
I20260204 09:11:22.116523 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 103 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 102 index: 97. Preceding OpId from leader: term: 103 index: 98. (index mismatch)
I20260204 09:11:22.116739 10567 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 98, Last known committed idx: 97, Time since last communication: 0.000s
I20260204 09:11:22.300084 10564 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 103 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:22.300169 10564 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 103 FOLLOWER]: Advancing to term 104
I20260204 09:11:22.300789 10564 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 104 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:22.300958 10564 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 104 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:22.301138 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 104 candidate_status { last_received { term: 103 index: 98 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:22.301155 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 104 candidate_status { last_received { term: 103 index: 98 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:22.301340 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 104 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11502cf05241427fb9853e628add7746; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:22.301448 10564 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 104 FOLLOWER]: Leader election lost for term 104. Reason: could not achieve majority
I20260204 09:11:22.312985 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 104 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 103. Current term is 104. Ops: []
I20260204 09:11:22.313212 10559 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 103.98, Next index: 99, Last known committed idx: 98, Time since last communication: 0.000s
I20260204 09:11:22.313325 10559 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 103 LEADER]: Stepping down as leader of term 103
I20260204 09:11:22.313375 10559 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 103 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:22.313436 10559 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 98, Committed index: 98, Last appended: 103.98, Last appended by leader: 98, Current term: 103, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:22.313515 10559 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 103 FOLLOWER]: Advancing to term 104
I20260204 09:11:22.336956 10565 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 103 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:22.337030 10565 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 103 FOLLOWER]: Advancing to term 104
I20260204 09:11:22.337657 10565 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 104 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:22.337806 10565 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 104 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:22.338002 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 104 candidate_status { last_received { term: 103 index: 98 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:22.337999 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 104 candidate_status { last_received { term: 103 index: 98 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:22.338090 10246 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 104 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in current term 104: Already voted for candidate 11502cf05241427fb9853e628add7746 in this term.
I20260204 09:11:22.338603 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 104 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 104.
I20260204 09:11:22.338757 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 104 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:22.338833 10565 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 104 FOLLOWER]: Leader election won for term 104
I20260204 09:11:22.338886 10565 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 104 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:22.338932 10565 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 98, Committed index: 98, Last appended: 103.98, Last appended by leader: 98, Current term: 104, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:22.339346 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 103 to 104, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 104 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:22.440681 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 104 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 103 index: 98. Preceding OpId from leader: term: 104 index: 99. (index mismatch)
I20260204 09:11:22.440958 10565 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 99, Last known committed idx: 98, Time since last communication: 0.000s
I20260204 09:11:22.441514 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 104 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 103 index: 98. Preceding OpId from leader: term: 104 index: 99. (index mismatch)
I20260204 09:11:22.441955 10565 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 99, Last known committed idx: 98, Time since last communication: 0.000s
I20260204 09:11:22.542557 10559 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 104 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:22.542670 10559 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 104 FOLLOWER]: Advancing to term 105
I20260204 09:11:22.543318 10559 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 105 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:22.543469 10559 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 105 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:22.543635 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 105 candidate_status { last_received { term: 104 index: 99 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:22.543650 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 105 candidate_status { last_received { term: 104 index: 99 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:22.543860 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 105 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:22.543949 10559 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 105 FOLLOWER]: Leader election lost for term 105. Reason: could not achieve majority
I20260204 09:11:22.550438 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 105 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 104. Current term is 105. Ops: []
I20260204 09:11:22.550618 10570 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 104.99, Next index: 100, Last known committed idx: 99, Time since last communication: 0.000s
I20260204 09:11:22.550726 10570 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 104 LEADER]: Stepping down as leader of term 104
I20260204 09:11:22.550756 10570 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 104 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:22.550807 10570 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 99, Committed index: 99, Last appended: 104.99, Last appended by leader: 99, Current term: 104, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:22.550879 10570 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 104 FOLLOWER]: Advancing to term 105
I20260204 09:11:22.630539 10564 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 104 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:22.630641 10564 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 104 FOLLOWER]: Advancing to term 105
I20260204 09:11:22.631309 10564 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 105 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:22.631474 10564 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 105 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:22.631672 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 105 candidate_status { last_received { term: 104 index: 99 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:22.631687 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 105 candidate_status { last_received { term: 104 index: 99 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:22.631786 10322 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 105 FOLLOWER]: Leader election vote request: Denying vote to candidate 11502cf05241427fb9853e628add7746 in current term 105: Already voted for candidate bd38b0e96f264071a69be73b6b4f14c1 in this term.
I20260204 09:11:22.632309 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 105 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 105.
I20260204 09:11:22.632473 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 105 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:22.632553 10564 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 105 FOLLOWER]: Leader election won for term 105
I20260204 09:11:22.632658 10564 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 105 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:22.632700 10564 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 99, Committed index: 99, Last appended: 104.99, Last appended by leader: 99, Current term: 105, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:22.633133 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 104 to 105, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 105 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:22.650084 10559 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 105 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:22.650178 10559 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 105 FOLLOWER]: Advancing to term 106
I20260204 09:11:22.650815 10559 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 106 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:22.650985 10559 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 106 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:22.651204 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 106 candidate_status { last_received { term: 104 index: 99 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:22.651201 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 106 candidate_status { last_received { term: 104 index: 99 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:22.651314 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 105 FOLLOWER]: Advancing to term 106
I20260204 09:11:22.651872 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 106 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 106.
I20260204 09:11:22.652087 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 106 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:22.652209 10559 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 106 FOLLOWER]: Leader election won for term 106
I20260204 09:11:22.652268 10559 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 106 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:22.652351 10559 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 99, Committed index: 99, Last appended: 104.99, Last appended by leader: 99, Current term: 106, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:22.652782 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 105 to 106, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 106 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:22.724458 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 106 LEADER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 105. Current term is 106. Ops: []
I20260204 09:11:22.724711 10564 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 0.0, Next index: 100, Last known committed idx: 99, Time since last communication: 0.000s
I20260204 09:11:22.724799 10564 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer bd38b0e96f264071a69be73b6b4f14c1 log is divergent from this leader: its last log entry 106.100 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 99
I20260204 09:11:22.724838 10571 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 105 LEADER]: Stepping down as leader of term 105
I20260204 09:11:22.724880 10571 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 105 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:22.724929 10571 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 99, Committed index: 99, Last appended: 105.100, Last appended by leader: 100, Current term: 105, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:22.724996 10571 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 105 FOLLOWER]: Advancing to term 106
I20260204 09:11:22.745167 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 106 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 105 index: 100. Preceding OpId from leader: term: 106 index: 100. (term mismatch)
I20260204 09:11:22.745239 10246 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting all ops after (but not including) 99
I20260204 09:11:22.745251 10246 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting uncommitted NO_OP operation due to leader change: 105.100
I20260204 09:11:22.745265 10246 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 106 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:22.745471 10559 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 100, Last known committed idx: 99, Time since last communication: 0.000s
I20260204 09:11:22.746464 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 106 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 104 index: 99. Preceding OpId from leader: term: 106 index: 100. (index mismatch)
I20260204 09:11:22.746680 10569 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 100, Last known committed idx: 99, Time since last communication: 0.000s
I20260204 09:11:22.928049 10570 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 106 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:22.928150 10570 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 106 FOLLOWER]: Advancing to term 107
I20260204 09:11:22.928836 10570 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 107 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:22.929004 10570 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 107 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:22.929196 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 107 candidate_status { last_received { term: 106 index: 100 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:22.929196 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 107 candidate_status { last_received { term: 106 index: 100 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:22.929471 10362 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 107 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:22.929584 10570 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 107 FOLLOWER]: Leader election lost for term 107. Reason: could not achieve majority
I20260204 09:11:22.941671 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 107 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 106. Current term is 107. Ops: []
I20260204 09:11:22.941886 10559 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 106.100, Next index: 101, Last known committed idx: 100, Time since last communication: 0.000s
I20260204 09:11:22.942020 10569 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 106 LEADER]: Stepping down as leader of term 106
I20260204 09:11:22.942061 10569 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 106 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:22.942128 10569 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 100, Committed index: 100, Last appended: 106.100, Last appended by leader: 100, Current term: 106, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:22.942212 10569 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 106 FOLLOWER]: Advancing to term 107
I20260204 09:11:22.954123 10571 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 106 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:22.954195 10571 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 106 FOLLOWER]: Advancing to term 107
I20260204 09:11:22.954747 10571 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 107 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:22.954891 10571 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 107 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:22.955088 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 107 candidate_status { last_received { term: 106 index: 100 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:22.955088 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 107 candidate_status { last_received { term: 106 index: 100 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:22.955195 10397 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 107 FOLLOWER]: Leader election vote request: Denying vote to candidate 11502cf05241427fb9853e628add7746 in current term 107: Already voted for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in this term.
I20260204 09:11:22.955677 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 107 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 107.
I20260204 09:11:22.955860 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 107 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:22.955937 10571 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 107 FOLLOWER]: Leader election won for term 107
I20260204 09:11:22.955981 10571 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 107 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:22.956017 10571 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 100, Committed index: 100, Last appended: 106.100, Last appended by leader: 100, Current term: 107, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:22.956411 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 106 to 107, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 107 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:22.980454 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:23.033710 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 107 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 106 index: 100. Preceding OpId from leader: term: 107 index: 101. (index mismatch)
I20260204 09:11:23.033950 10571 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 101, Last known committed idx: 100, Time since last communication: 0.000s
I20260204 09:11:23.034924 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 107 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 106 index: 100. Preceding OpId from leader: term: 107 index: 101. (index mismatch)
I20260204 09:11:23.035126 10571 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 101, Last known committed idx: 100, Time since last communication: 0.000s
I20260204 09:11:23.135407 10570 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 107 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:23.135502 10570 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 107 FOLLOWER]: Advancing to term 108
I20260204 09:11:23.136149 10570 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 108 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:23.136315 10570 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 108 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:23.136510 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 108 candidate_status { last_received { term: 107 index: 101 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:23.136514 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 108 candidate_status { last_received { term: 107 index: 101 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:23.136649 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 107 FOLLOWER]: Advancing to term 108
I20260204 09:11:23.137182 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 108 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 108.
I20260204 09:11:23.137329 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 108 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:23.137434 10570 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 108 FOLLOWER]: Leader election won for term 108
I20260204 09:11:23.137550 10570 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 108 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:23.137619 10570 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 101, Committed index: 101, Last appended: 107.101, Last appended by leader: 101, Current term: 108, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:23.138041 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 107 to 108, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 108 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:23.145062 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 108 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 107. Current term is 108. Ops: []
I20260204 09:11:23.145267 10572 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 107.101, Next index: 102, Last known committed idx: 101, Time since last communication: 0.000s
I20260204 09:11:23.145388 10572 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 107 LEADER]: Stepping down as leader of term 107
I20260204 09:11:23.145421 10572 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 107 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:23.145478 10572 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 101, Committed index: 101, Last appended: 107.101, Last appended by leader: 101, Current term: 107, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:23.145558 10572 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 107 FOLLOWER]: Advancing to term 108
I20260204 09:11:23.225387 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 108 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 107 index: 101. Preceding OpId from leader: term: 108 index: 102. (index mismatch)
I20260204 09:11:23.225630 10570 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 102, Last known committed idx: 101, Time since last communication: 0.000s
I20260204 09:11:23.226567 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 108 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 107 index: 101. Preceding OpId from leader: term: 108 index: 102. (index mismatch)
I20260204 09:11:23.226750 10570 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 102, Last known committed idx: 101, Time since last communication: 0.000s
I20260204 09:11:23.421113 10559 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 108 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:23.421206 10559 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 108 FOLLOWER]: Advancing to term 109
I20260204 09:11:23.422470 10559 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 109 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:23.422612 10559 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 109 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:23.422920 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 109 candidate_status { last_received { term: 108 index: 102 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:23.422895 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 109 candidate_status { last_received { term: 108 index: 102 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:23.423167 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 109 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:23.423264 10559 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 109 FOLLOWER]: Leader election lost for term 109. Reason: could not achieve majority
I20260204 09:11:23.426091 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 109 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 108. Current term is 109. Ops: []
I20260204 09:11:23.426271 10570 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 108.102, Next index: 103, Last known committed idx: 102, Time since last communication: 0.000s
I20260204 09:11:23.426379 10573 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 108 LEADER]: Stepping down as leader of term 108
I20260204 09:11:23.426419 10573 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 108 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:23.426496 10573 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 102, Committed index: 102, Last appended: 108.102, Last appended by leader: 102, Current term: 108, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:23.426568 10573 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 108 FOLLOWER]: Advancing to term 109
I20260204 09:11:23.451401 10572 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 108 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:23.451483 10572 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 108 FOLLOWER]: Advancing to term 109
I20260204 09:11:23.452067 10572 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 109 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:23.452304 10572 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 109 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:23.452448 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 109 candidate_status { last_received { term: 108 index: 102 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:23.452415 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 109 candidate_status { last_received { term: 108 index: 102 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:23.452533 10322 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 109 FOLLOWER]: Leader election vote request: Denying vote to candidate 11502cf05241427fb9853e628add7746 in current term 109: Already voted for candidate bd38b0e96f264071a69be73b6b4f14c1 in this term.
I20260204 09:11:23.453034 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 109 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 109.
I20260204 09:11:23.453173 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 109 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:23.453258 10572 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 109 FOLLOWER]: Leader election won for term 109
I20260204 09:11:23.453305 10572 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 109 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:23.453346 10572 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 102, Committed index: 102, Last appended: 108.102, Last appended by leader: 102, Current term: 109, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:23.453799 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 108 to 109, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 109 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:23.536624 10559 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 109 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:23.536720 10559 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 109 FOLLOWER]: Advancing to term 110
I20260204 09:11:23.537338 10559 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 110 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:23.537500 10559 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 110 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:23.537729 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 110 candidate_status { last_received { term: 108 index: 102 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:23.537735 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 110 candidate_status { last_received { term: 108 index: 102 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:23.537820 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 109 FOLLOWER]: Advancing to term 110
I20260204 09:11:23.538367 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 110 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 110.
I20260204 09:11:23.538511 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 110 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:23.538599 10559 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 110 FOLLOWER]: Leader election won for term 110
I20260204 09:11:23.538654 10559 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 110 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:23.538691 10559 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 102, Committed index: 102, Last appended: 108.102, Last appended by leader: 102, Current term: 110, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:23.539085 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 109 to 110, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 110 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:23.566423 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 110 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 109. Current term is 110. Ops: []
I20260204 09:11:23.566689 10572 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 103, Last known committed idx: 102, Time since last communication: 0.000s
I20260204 09:11:23.566790 10572 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 109 LEADER]: Stepping down as leader of term 109
I20260204 09:11:23.566817 10572 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 109 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:23.566885 10572 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 102, Committed index: 102, Last appended: 109.103, Last appended by leader: 103, Current term: 109, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:23.566952 10572 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 109 FOLLOWER]: Advancing to term 110
I20260204 09:11:23.616384 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 110 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 109 index: 103. Preceding OpId from leader: term: 110 index: 103. (term mismatch)
I20260204 09:11:23.616458 10246 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting all ops after (but not including) 102
I20260204 09:11:23.616477 10246 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting uncommitted NO_OP operation due to leader change: 109.103
I20260204 09:11:23.616493 10246 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 110 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:23.616716 10559 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 103, Last known committed idx: 102, Time since last communication: 0.000s
I20260204 09:11:23.617921 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 110 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 108 index: 102. Preceding OpId from leader: term: 110 index: 103. (index mismatch)
I20260204 09:11:23.618100 10574 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 103, Last known committed idx: 102, Time since last communication: 0.000s
I20260204 09:11:23.719183 10573 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 110 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:23.719270 10573 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 110 FOLLOWER]: Advancing to term 111
I20260204 09:11:23.719902 10573 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 111 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:23.720055 10573 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 111 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:23.720242 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 111 candidate_status { last_received { term: 110 index: 103 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:23.720310 10246 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 110 FOLLOWER]: Advancing to term 111
I20260204 09:11:23.720247 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 111 candidate_status { last_received { term: 110 index: 103 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:23.720888 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 111 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 111.
I20260204 09:11:23.721031 10362 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 111 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:23.721123 10573 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 111 FOLLOWER]: Leader election won for term 111
I20260204 09:11:23.721174 10573 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 111 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:23.721226 10573 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 103, Committed index: 103, Last appended: 110.103, Last appended by leader: 103, Current term: 111, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:23.721678 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 110 to 111, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 111 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:23.727773 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 111 LEADER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 110. Current term is 111. Ops: []
I20260204 09:11:23.727999 10559 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 110.103, Next index: 104, Last known committed idx: 103, Time since last communication: 0.000s
I20260204 09:11:23.728082 10559 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer 8b12f9075d9d4ffa9fd711322da0c4d2 log is divergent from this leader: its last log entry 111.104 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 103
I20260204 09:11:23.728109 10569 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 110 LEADER]: Stepping down as leader of term 110
I20260204 09:11:23.728147 10569 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 110 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:23.728206 10569 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 103, Committed index: 103, Last appended: 110.103, Last appended by leader: 103, Current term: 110, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:23.728292 10569 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 110 FOLLOWER]: Advancing to term 111
I20260204 09:11:23.799012 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 111 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 110 index: 103. Preceding OpId from leader: term: 111 index: 104. (index mismatch)
I20260204 09:11:23.799278 10573 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 104, Last known committed idx: 103, Time since last communication: 0.000s
I20260204 09:11:23.800258 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 111 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 110 index: 103. Preceding OpId from leader: term: 111 index: 104. (index mismatch)
I20260204 09:11:23.800530 10575 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 104, Last known committed idx: 103, Time since last communication: 0.000s
I20260204 09:11:23.980682 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:24.012869 10559 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 111 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:24.012964 10559 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 111 FOLLOWER]: Advancing to term 112
I20260204 09:11:24.013639 10559 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 112 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:24.013803 10559 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 112 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:24.014032 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 112 candidate_status { last_received { term: 111 index: 104 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:24.014036 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 112 candidate_status { last_received { term: 111 index: 104 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:24.014269 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 112 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:24.014359 10559 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 112 FOLLOWER]: Leader election lost for term 112. Reason: could not achieve majority
I20260204 09:11:24.017580 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 112 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 111. Current term is 112. Ops: []
I20260204 09:11:24.017745 10573 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 111.104, Next index: 105, Last known committed idx: 104, Time since last communication: 0.000s
I20260204 09:11:24.017845 10570 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 111 LEADER]: Stepping down as leader of term 111
I20260204 09:11:24.017889 10570 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 111 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:24.017932 10570 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 104, Committed index: 104, Last appended: 111.104, Last appended by leader: 104, Current term: 111, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:24.018006 10570 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 111 FOLLOWER]: Advancing to term 112
I20260204 09:11:24.093040 10572 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 111 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:24.093151 10572 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 111 FOLLOWER]: Advancing to term 112
I20260204 09:11:24.093839 10572 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 112 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:24.094009 10572 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 112 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:24.094202 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 112 candidate_status { last_received { term: 111 index: 104 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:24.094208 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 112 candidate_status { last_received { term: 111 index: 104 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:24.094352 10322 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 112 FOLLOWER]: Leader election vote request: Denying vote to candidate 11502cf05241427fb9853e628add7746 in current term 112: Already voted for candidate bd38b0e96f264071a69be73b6b4f14c1 in this term.
I20260204 09:11:24.094838 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 112 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 112.
I20260204 09:11:24.095011 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 112 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:24.095085 10572 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 112 FOLLOWER]: Leader election won for term 112
I20260204 09:11:24.095193 10572 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 112 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:24.095247 10572 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 104, Committed index: 104, Last appended: 111.104, Last appended by leader: 104, Current term: 112, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:24.095647 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 111 to 112, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 112 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:24.125943 10559 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 112 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:24.126024 10559 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 112 FOLLOWER]: Advancing to term 113
I20260204 09:11:24.126628 10559 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 113 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:24.126767 10559 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 113 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:24.126956 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 113 candidate_status { last_received { term: 111 index: 104 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:24.127015 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 112 FOLLOWER]: Advancing to term 113
I20260204 09:11:24.126978 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 113 candidate_status { last_received { term: 111 index: 104 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:24.127511 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 113 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 113.
I20260204 09:11:24.127650 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 113 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:24.127743 10559 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 113 FOLLOWER]: Leader election won for term 113
I20260204 09:11:24.127794 10559 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 113 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:24.127861 10559 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 104, Committed index: 104, Last appended: 111.104, Last appended by leader: 104, Current term: 113, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:24.128278 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 112 to 113, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 113 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:24.190788 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 113 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 112. Current term is 113. Ops: []
I20260204 09:11:24.191053 10572 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 105, Last known committed idx: 104, Time since last communication: 0.000s
I20260204 09:11:24.191161 10572 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 112 LEADER]: Stepping down as leader of term 112
I20260204 09:11:24.191195 10572 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 112 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:24.191252 10572 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 104, Committed index: 104, Last appended: 112.105, Last appended by leader: 105, Current term: 112, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:24.191324 10572 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 112 FOLLOWER]: Advancing to term 113
I20260204 09:11:24.207597 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 113 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 112 index: 105. Preceding OpId from leader: term: 113 index: 105. (term mismatch)
I20260204 09:11:24.207666 10246 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting all ops after (but not including) 104
I20260204 09:11:24.207679 10246 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting uncommitted NO_OP operation due to leader change: 112.105
I20260204 09:11:24.207692 10246 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 113 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:24.207885 10559 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 105, Last known committed idx: 104, Time since last communication: 0.000s
I20260204 09:11:24.208881 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 113 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 111 index: 104. Preceding OpId from leader: term: 113 index: 105. (index mismatch)
I20260204 09:11:24.209064 10569 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 105, Last known committed idx: 104, Time since last communication: 0.000s
I20260204 09:11:24.484544 10570 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 113 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:24.484624 10570 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 113 FOLLOWER]: Advancing to term 114
I20260204 09:11:24.485250 10570 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 114 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:24.485431 10570 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 114 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:24.485597 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 114 candidate_status { last_received { term: 113 index: 105 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:24.485625 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 114 candidate_status { last_received { term: 113 index: 105 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:24.485822 10362 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 114 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:24.485909 10570 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 114 FOLLOWER]: Leader election lost for term 114. Reason: could not achieve majority
I20260204 09:11:24.499420 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 114 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 113. Current term is 114. Ops: []
I20260204 09:11:24.499655 10559 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 113.105, Next index: 106, Last known committed idx: 105, Time since last communication: 0.000s
I20260204 09:11:24.499779 10559 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 113 LEADER]: Stepping down as leader of term 113
I20260204 09:11:24.499814 10559 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 113 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:24.499861 10559 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 105, Committed index: 105, Last appended: 113.105, Last appended by leader: 105, Current term: 113, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:24.499946 10559 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 113 FOLLOWER]: Advancing to term 114
I20260204 09:11:24.584172 10572 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 113 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:24.584276 10572 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 113 FOLLOWER]: Advancing to term 114
I20260204 09:11:24.584923 10572 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 114 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:24.585083 10572 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 114 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:24.585287 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 114 candidate_status { last_received { term: 113 index: 105 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:24.585287 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 114 candidate_status { last_received { term: 113 index: 105 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:24.585451 10397 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 114 FOLLOWER]: Leader election vote request: Denying vote to candidate 11502cf05241427fb9853e628add7746 in current term 114: Already voted for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in this term.
I20260204 09:11:24.585942 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 114 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 114.
I20260204 09:11:24.586098 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 114 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:24.586195 10572 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 114 FOLLOWER]: Leader election won for term 114
I20260204 09:11:24.586248 10572 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 114 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:24.586303 10572 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 105, Committed index: 105, Last appended: 113.105, Last appended by leader: 105, Current term: 114, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:24.586738 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 113 to 114, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 114 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:24.619903 10570 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 114 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:24.620013 10570 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 114 FOLLOWER]: Advancing to term 115
I20260204 09:11:24.620749 10570 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 115 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:24.620949 10570 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 115 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:24.621137 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 115 candidate_status { last_received { term: 113 index: 105 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:24.621146 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 115 candidate_status { last_received { term: 113 index: 105 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:24.621238 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 114 FOLLOWER]: Advancing to term 115
I20260204 09:11:24.621837 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 115 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 115.
I20260204 09:11:24.622006 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 115 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:24.622092 10570 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 115 FOLLOWER]: Leader election won for term 115
I20260204 09:11:24.622205 10570 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 115 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:24.622252 10570 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 105, Committed index: 105, Last appended: 113.105, Last appended by leader: 105, Current term: 115, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:24.622687 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 114 to 115, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 115 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:24.663071 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 115 LEADER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 114. Current term is 115. Ops: []
I20260204 09:11:24.663317 10572 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 106, Last known committed idx: 105, Time since last communication: 0.000s
I20260204 09:11:24.663409 10572 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer 8b12f9075d9d4ffa9fd711322da0c4d2 log is divergent from this leader: its last log entry 115.106 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 105
I20260204 09:11:24.663450 10576 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 114 LEADER]: Stepping down as leader of term 114
I20260204 09:11:24.663484 10576 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 114 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:24.663538 10576 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 105, Committed index: 105, Last appended: 114.106, Last appended by leader: 106, Current term: 114, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:24.663614 10576 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 114 FOLLOWER]: Advancing to term 115
I20260204 09:11:24.728040 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 115 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 114 index: 106. Preceding OpId from leader: term: 115 index: 106. (term mismatch)
I20260204 09:11:24.728114 10246 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting all ops after (but not including) 105
I20260204 09:11:24.728127 10246 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting uncommitted NO_OP operation due to leader change: 114.106
I20260204 09:11:24.728140 10246 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 115 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:24.728345 10570 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 106, Last known committed idx: 105, Time since last communication: 0.000s
I20260204 09:11:24.729401 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 115 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 113 index: 105. Preceding OpId from leader: term: 115 index: 106. (index mismatch)
I20260204 09:11:24.729555 10570 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 106, Last known committed idx: 105, Time since last communication: 0.000s
I20260204 09:11:24.830722 10559 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 115 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:24.830822 10559 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 115 FOLLOWER]: Advancing to term 116
I20260204 09:11:24.831434 10559 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 116 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:24.831568 10559 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 116 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:24.831761 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 116 candidate_status { last_received { term: 115 index: 106 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:24.831779 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 116 candidate_status { last_received { term: 115 index: 106 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:24.831984 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 116 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:24.832072 10559 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 116 FOLLOWER]: Leader election lost for term 116. Reason: could not achieve majority
I20260204 09:11:24.836278 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 116 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 115. Current term is 116. Ops: []
I20260204 09:11:24.836504 10577 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 115.106, Next index: 107, Last known committed idx: 106, Time since last communication: 0.000s
I20260204 09:11:24.836619 10577 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 115 LEADER]: Stepping down as leader of term 115
I20260204 09:11:24.836645 10577 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 115 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:24.836696 10577 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 106, Committed index: 106, Last appended: 115.106, Last appended by leader: 106, Current term: 115, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:24.836771 10577 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 115 FOLLOWER]: Advancing to term 116
I20260204 09:11:24.922297 10576 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 115 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:24.922389 10576 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 115 FOLLOWER]: Advancing to term 116
I20260204 09:11:24.923033 10576 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 116 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:24.923187 10576 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 116 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:24.923404 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 116 candidate_status { last_received { term: 115 index: 106 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:24.923417 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 116 candidate_status { last_received { term: 115 index: 106 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:24.923501 10322 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 116 FOLLOWER]: Leader election vote request: Denying vote to candidate 11502cf05241427fb9853e628add7746 in current term 116: Already voted for candidate bd38b0e96f264071a69be73b6b4f14c1 in this term.
I20260204 09:11:24.924067 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 116 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 116.
I20260204 09:11:24.924243 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 116 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:24.924327 10576 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 116 FOLLOWER]: Leader election won for term 116
I20260204 09:11:24.924376 10576 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 116 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:24.924417 10576 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 106, Committed index: 106, Last appended: 115.106, Last appended by leader: 106, Current term: 116, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:24.924839 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 115 to 116, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 116 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:24.945446 10559 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 116 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:24.945531 10559 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 116 FOLLOWER]: Advancing to term 117
I20260204 09:11:24.946149 10559 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 117 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:24.946297 10559 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 117 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:24.946506 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 117 candidate_status { last_received { term: 115 index: 106 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:24.946506 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 117 candidate_status { last_received { term: 115 index: 106 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:24.946619 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 116 FOLLOWER]: Advancing to term 117
I20260204 09:11:24.947121 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 117 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 117.
I20260204 09:11:24.947283 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 117 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:24.947381 10559 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 117 FOLLOWER]: Leader election won for term 117
I20260204 09:11:24.947439 10559 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 117 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:24.947512 10559 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 106, Committed index: 106, Last appended: 115.106, Last appended by leader: 106, Current term: 117, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:24.947889 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 116 to 117, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 117 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:24.980965 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:25.036268 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 117 LEADER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 116. Current term is 117. Ops: []
I20260204 09:11:25.036527 10576 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 0.0, Next index: 107, Last known committed idx: 106, Time since last communication: 0.000s
I20260204 09:11:25.036638 10576 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer bd38b0e96f264071a69be73b6b4f14c1 log is divergent from this leader: its last log entry 117.107 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 106
I20260204 09:11:25.036670 10572 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 116 LEADER]: Stepping down as leader of term 116
I20260204 09:11:25.036710 10572 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 116 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:25.036757 10572 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 106, Committed index: 106, Last appended: 116.107, Last appended by leader: 107, Current term: 116, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:25.036834 10572 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 116 FOLLOWER]: Advancing to term 117
I20260204 09:11:25.043164 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 117 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 115 index: 106. Preceding OpId from leader: term: 117 index: 107. (index mismatch)
I20260204 09:11:25.043381 10559 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 107, Last known committed idx: 106, Time since last communication: 0.000s
I20260204 09:11:25.044265 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 117 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 116 index: 107. Preceding OpId from leader: term: 117 index: 107. (term mismatch)
I20260204 09:11:25.044320 10246 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting all ops after (but not including) 106
I20260204 09:11:25.044338 10246 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting uncommitted NO_OP operation due to leader change: 116.107
I20260204 09:11:25.044355 10246 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 117 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:25.044515 10559 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 107, Last known committed idx: 106, Time since last communication: 0.000s
I20260204 09:11:25.236948 10577 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 117 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:25.237054 10577 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 117 FOLLOWER]: Advancing to term 118
I20260204 09:11:25.237802 10577 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 118 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:25.237939 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 118 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 117. Current term is 118. Ops: []
I20260204 09:11:25.237990 10577 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 118 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:25.238131 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 118 candidate_status { last_received { term: 117 index: 107 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:25.238132 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 118 candidate_status { last_received { term: 117 index: 107 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:25.238260 10246 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 117 FOLLOWER]: Advancing to term 118
I20260204 09:11:25.238427 10578 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 117.107, Next index: 108, Last known committed idx: 107, Time since last communication: 0.000s
I20260204 09:11:25.238541 10569 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 117 LEADER]: Stepping down as leader of term 117
I20260204 09:11:25.238576 10569 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 117 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:25.238649 10569 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 107, Committed index: 107, Last appended: 117.107, Last appended by leader: 107, Current term: 117, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:25.238736 10569 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 117 FOLLOWER]: Advancing to term 118
I20260204 09:11:25.238914 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 118 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 118.
I20260204 09:11:25.239061 10362 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 118 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:25.239164 10577 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 118 FOLLOWER]: Leader election won for term 118
I20260204 09:11:25.239224 10577 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 118 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:25.239265 10577 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 107, Committed index: 107, Last appended: 117.107, Last appended by leader: 107, Current term: 118, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:25.239665 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 117 to 118, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 118 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:25.337975 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 118 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 117 index: 107. Preceding OpId from leader: term: 118 index: 108. (index mismatch)
I20260204 09:11:25.338230 10577 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 108, Last known committed idx: 107, Time since last communication: 0.000s
I20260204 09:11:25.339186 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 118 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 117 index: 107. Preceding OpId from leader: term: 118 index: 108. (index mismatch)
I20260204 09:11:25.339402 10579 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 108, Last known committed idx: 107, Time since last communication: 0.000s
I20260204 09:11:25.527923 10572 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 118 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:25.528018 10572 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 118 FOLLOWER]: Advancing to term 119
I20260204 09:11:25.528734 10572 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 119 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:25.528869 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 119 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 118. Current term is 119. Ops: []
I20260204 09:11:25.528893 10572 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 119 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:25.529031 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 119 candidate_status { last_received { term: 118 index: 108 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:25.529050 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 119 candidate_status { last_received { term: 118 index: 108 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:25.529066 10577 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 118.108, Next index: 109, Last known committed idx: 108, Time since last communication: 0.000s
I20260204 09:11:25.529210 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 119 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11502cf05241427fb9853e628add7746; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:25.529266 10570 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 118 LEADER]: Stepping down as leader of term 118
I20260204 09:11:25.529301 10570 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 118 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:25.529299 10572 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 119 FOLLOWER]: Leader election lost for term 119. Reason: could not achieve majority
I20260204 09:11:25.529382 10570 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 108, Committed index: 108, Last appended: 118.108, Last appended by leader: 108, Current term: 118, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:25.529465 10570 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 118 FOLLOWER]: Advancing to term 119
I20260204 09:11:25.555006 10569 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 118 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:25.555094 10569 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 118 FOLLOWER]: Advancing to term 119
I20260204 09:11:25.555672 10569 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 119 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:25.555819 10569 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 119 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:25.556023 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 119 candidate_status { last_received { term: 118 index: 108 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:25.556037 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 119 candidate_status { last_received { term: 118 index: 108 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:25.556136 10246 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 119 FOLLOWER]: Leader election vote request: Denying vote to candidate bd38b0e96f264071a69be73b6b4f14c1 in current term 119: Already voted for candidate 11502cf05241427fb9853e628add7746 in this term.
I20260204 09:11:25.556579 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 119 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 119.
I20260204 09:11:25.556740 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 119 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:25.556824 10569 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 119 FOLLOWER]: Leader election won for term 119
I20260204 09:11:25.556883 10569 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 119 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:25.556939 10569 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 108, Committed index: 108, Last appended: 118.108, Last appended by leader: 108, Current term: 119, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:25.557371 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 118 to 119, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 119 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:25.651810 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 119 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 118 index: 108. Preceding OpId from leader: term: 119 index: 109. (index mismatch)
I20260204 09:11:25.652076 10569 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 109, Last known committed idx: 108, Time since last communication: 0.000s
I20260204 09:11:25.653059 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 119 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 118 index: 108. Preceding OpId from leader: term: 119 index: 109. (index mismatch)
I20260204 09:11:25.653237 10569 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 109, Last known committed idx: 108, Time since last communication: 0.000s
I20260204 09:11:25.926951 10572 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 119 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:25.927049 10572 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 119 FOLLOWER]: Advancing to term 120
I20260204 09:11:25.927680 10572 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 120 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:25.927852 10572 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 120 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:25.928041 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 120 candidate_status { last_received { term: 119 index: 109 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:25.928047 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 120 candidate_status { last_received { term: 119 index: 109 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:25.928287 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 120 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11502cf05241427fb9853e628add7746; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:25.928375 10572 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 120 FOLLOWER]: Leader election lost for term 120. Reason: could not achieve majority
I20260204 09:11:25.929562 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 120 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 119. Current term is 120. Ops: []
I20260204 09:11:25.929744 10580 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 119.109, Next index: 110, Last known committed idx: 109, Time since last communication: 0.000s
I20260204 09:11:25.929827 10580 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 119 LEADER]: Stepping down as leader of term 119
I20260204 09:11:25.929857 10580 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 119 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:25.929910 10580 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 109, Committed index: 109, Last appended: 119.109, Last appended by leader: 109, Current term: 119, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:25.929970 10580 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 119 FOLLOWER]: Advancing to term 120
I20260204 09:11:25.941941 10570 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 119 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:25.941990 10570 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 119 FOLLOWER]: Advancing to term 120
I20260204 09:11:25.942467 10570 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 120 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:25.942595 10570 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 120 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:25.942728 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 120 candidate_status { last_received { term: 119 index: 109 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:25.942728 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 120 candidate_status { last_received { term: 119 index: 109 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:25.942847 10246 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 120 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in current term 120: Already voted for candidate 11502cf05241427fb9853e628add7746 in this term.
I20260204 09:11:25.943328 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 120 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 120.
I20260204 09:11:25.943463 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 120 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:25.943542 10570 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 120 FOLLOWER]: Leader election won for term 120
I20260204 09:11:25.943598 10570 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 120 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:25.943632 10570 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 109, Committed index: 109, Last appended: 119.109, Last appended by leader: 109, Current term: 120, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:25.944027 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 119 to 120, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 120 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:25.981186 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:26.031366 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 120 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 119 index: 109. Preceding OpId from leader: term: 120 index: 110. (index mismatch)
I20260204 09:11:26.031620 10570 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 110, Last known committed idx: 109, Time since last communication: 0.000s
I20260204 09:11:26.032584 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 120 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 119 index: 109. Preceding OpId from leader: term: 120 index: 110. (index mismatch)
I20260204 09:11:26.032811 10577 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 110, Last known committed idx: 109, Time since last communication: 0.000s
I20260204 09:11:26.223495 10572 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 120 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:26.223624 10572 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 120 FOLLOWER]: Advancing to term 121
I20260204 09:11:26.224256 10572 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 121 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:26.224426 10572 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 121 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:26.224557 10580 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 120 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:26.224632 10580 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 120 FOLLOWER]: Advancing to term 121
I20260204 09:11:26.224615 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 121 candidate_status { last_received { term: 120 index: 110 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:26.224615 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 121 candidate_status { last_received { term: 120 index: 110 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:26.225296 10580 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 121 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:26.225430 10322 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 121 FOLLOWER]: Leader election vote request: Denying vote to candidate 11502cf05241427fb9853e628add7746 in current term 121: Already voted for candidate bd38b0e96f264071a69be73b6b4f14c1 in this term.
I20260204 09:11:26.225464 10580 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 121 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:26.225596 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 121 candidate_status { last_received { term: 120 index: 110 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:26.225641 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 121 candidate_status { last_received { term: 120 index: 110 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:26.225603 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 121 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11502cf05241427fb9853e628add7746; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:26.225714 10246 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 121 FOLLOWER]: Leader election vote request: Denying vote to candidate bd38b0e96f264071a69be73b6b4f14c1 in current term 121: Already voted for candidate 11502cf05241427fb9853e628add7746 in this term.
I20260204 09:11:26.225760 10572 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 121 FOLLOWER]: Leader election lost for term 121. Reason: could not achieve majority
I20260204 09:11:26.225849 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 121 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:26.225943 10580 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 121 FOLLOWER]: Leader election lost for term 121. Reason: could not achieve majority
I20260204 09:11:26.243244 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 121 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 120. Current term is 121. Ops: []
I20260204 09:11:26.243239 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 121 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 120. Current term is 121. Ops: []
I20260204 09:11:26.243454 10577 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 120.110, Next index: 111, Last known committed idx: 110, Time since last communication: 0.000s
I20260204 09:11:26.243577 10570 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 120 LEADER]: Stepping down as leader of term 120
I20260204 09:11:26.243618 10570 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 120 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:26.243595 10581 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 120.110, Next index: 111, Last known committed idx: 110, Time since last communication: 0.000s
I20260204 09:11:26.243741 10570 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 110, Committed index: 110, Last appended: 120.110, Last appended by leader: 110, Current term: 120, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:26.243816 10570 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 120 FOLLOWER]: Advancing to term 121
I20260204 09:11:26.346179 10572 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 121 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:26.346273 10572 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 121 FOLLOWER]: Advancing to term 122
I20260204 09:11:26.346884 10572 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 122 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:26.347033 10572 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 122 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:26.347234 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 122 candidate_status { last_received { term: 120 index: 110 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:26.347311 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 121 FOLLOWER]: Advancing to term 122
I20260204 09:11:26.347239 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 122 candidate_status { last_received { term: 120 index: 110 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:26.347343 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 121 FOLLOWER]: Advancing to term 122
I20260204 09:11:26.347837 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 122 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 122.
I20260204 09:11:26.347908 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 122 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 122.
I20260204 09:11:26.348031 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 122 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters:
I20260204 09:11:26.348131 10572 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 122 FOLLOWER]: Leader election won for term 122
I20260204 09:11:26.348253 10572 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 122 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:26.348309 10572 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 110, Committed index: 110, Last appended: 120.110, Last appended by leader: 110, Current term: 122, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:26.348729 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 120 to 122, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 122 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:26.455176 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 122 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 120 index: 110. Preceding OpId from leader: term: 122 index: 111. (index mismatch)
I20260204 09:11:26.455442 10572 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 111, Last known committed idx: 110, Time since last communication: 0.000s
I20260204 09:11:26.456517 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 122 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 120 index: 110. Preceding OpId from leader: term: 122 index: 111. (index mismatch)
I20260204 09:11:26.456692 10582 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 111, Last known committed idx: 110, Time since last communication: 0.000s
I20260204 09:11:26.557477 10570 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 122 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:26.557562 10570 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 122 FOLLOWER]: Advancing to term 123
I20260204 09:11:26.558189 10570 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 123 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:26.558332 10570 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 123 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:26.558529 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 123 candidate_status { last_received { term: 122 index: 111 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:26.558521 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 123 candidate_status { last_received { term: 122 index: 111 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:26.558753 10362 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 123 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:26.558853 10570 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 123 FOLLOWER]: Leader election lost for term 123. Reason: could not achieve majority
I20260204 09:11:26.580691 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 123 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 122. Current term is 123. Ops: []
I20260204 09:11:26.580928 10583 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 122.111, Next index: 112, Last known committed idx: 111, Time since last communication: 0.000s
I20260204 09:11:26.581058 10583 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 122 LEADER]: Stepping down as leader of term 122
I20260204 09:11:26.581091 10583 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 122 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:26.581158 10583 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 111, Committed index: 111, Last appended: 122.111, Last appended by leader: 111, Current term: 122, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:26.581259 10583 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 122 FOLLOWER]: Advancing to term 123
I20260204 09:11:26.650115 10580 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 122 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:26.650220 10580 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 122 FOLLOWER]: Advancing to term 123
I20260204 09:11:26.650887 10580 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 123 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:26.651042 10580 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 123 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:26.651266 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 123 candidate_status { last_received { term: 122 index: 111 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:26.651247 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 123 candidate_status { last_received { term: 122 index: 111 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:26.651355 10397 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 123 FOLLOWER]: Leader election vote request: Denying vote to candidate bd38b0e96f264071a69be73b6b4f14c1 in current term 123: Already voted for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in this term.
I20260204 09:11:26.651875 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 123 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 123.
I20260204 09:11:26.652040 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 123 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:26.652115 10580 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 123 FOLLOWER]: Leader election won for term 123
I20260204 09:11:26.652225 10580 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 123 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:26.652287 10580 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 111, Committed index: 111, Last appended: 122.111, Last appended by leader: 111, Current term: 123, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:26.652712 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 122 to 123, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 123 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:26.680156 10570 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 123 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:26.680248 10570 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 123 FOLLOWER]: Advancing to term 124
I20260204 09:11:26.680876 10570 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 124 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:26.681056 10570 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 124 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:26.681252 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 124 candidate_status { last_received { term: 122 index: 111 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:26.681250 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 124 candidate_status { last_received { term: 122 index: 111 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:26.681389 10246 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 123 FOLLOWER]: Advancing to term 124
I20260204 09:11:26.681952 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 124 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 124.
I20260204 09:11:26.682117 10362 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 124 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:26.682221 10570 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 124 FOLLOWER]: Leader election won for term 124
I20260204 09:11:26.682294 10570 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 124 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:26.682346 10570 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 111, Committed index: 111, Last appended: 122.111, Last appended by leader: 111, Current term: 124, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:26.682777 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 123 to 124, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 124 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:26.768131 10322 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 123 LEADER]: Stepping down as leader of term 123
I20260204 09:11:26.768206 10322 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 123 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:26.768265 10322 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 111, Committed index: 111, Last appended: 123.112, Last appended by leader: 112, Current term: 123, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:26.768352 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 123 FOLLOWER]: Advancing to term 124
I20260204 09:11:26.768971 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 124 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 123 index: 112. Preceding OpId from leader: term: 124 index: 112. (term mismatch)
I20260204 09:11:26.769017 10322 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Aborting all ops after (but not including) 111
I20260204 09:11:26.769033 10322 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Aborting uncommitted NO_OP operation due to leader change: 123.112
I20260204 09:11:26.769052 10322 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 124 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:26.769263 10570 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 112, Last known committed idx: 111, Time since last communication: 0.000s
I20260204 09:11:26.770220 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 124 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 122 index: 111. Preceding OpId from leader: term: 124 index: 112. (index mismatch)
I20260204 09:11:26.770390 10581 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 112, Last known committed idx: 111, Time since last communication: 0.000s
I20260204 09:11:26.968863 10572 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 124 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:26.968943 10572 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 124 FOLLOWER]: Advancing to term 125
I20260204 09:11:26.969563 10572 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 125 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:26.969696 10572 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 125 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:26.969851 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 125 candidate_status { last_received { term: 124 index: 112 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:26.969862 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 125 candidate_status { last_received { term: 124 index: 112 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:26.970081 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 125 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11502cf05241427fb9853e628add7746; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:26.970165 10572 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 125 FOLLOWER]: Leader election lost for term 125. Reason: could not achieve majority
I20260204 09:11:26.973330 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 125 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 124. Current term is 125. Ops: []
I20260204 09:11:26.973518 10570 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 124.112, Next index: 113, Last known committed idx: 112, Time since last communication: 0.000s
I20260204 09:11:26.973629 10585 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 124 LEADER]: Stepping down as leader of term 124
I20260204 09:11:26.973683 10585 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 124 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:26.973750 10585 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 112, Committed index: 112, Last appended: 124.112, Last appended by leader: 112, Current term: 124, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:26.973832 10585 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 124 FOLLOWER]: Advancing to term 125
I20260204 09:11:26.981415 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:27.067404 10580 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 124 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:27.067498 10580 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 124 FOLLOWER]: Advancing to term 125
I20260204 09:11:27.068133 10580 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 125 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:27.068267 10580 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 125 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:27.068480 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 125 candidate_status { last_received { term: 124 index: 112 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:27.068493 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 125 candidate_status { last_received { term: 124 index: 112 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:27.068631 10246 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 125 FOLLOWER]: Leader election vote request: Denying vote to candidate bd38b0e96f264071a69be73b6b4f14c1 in current term 125: Already voted for candidate 11502cf05241427fb9853e628add7746 in this term.
I20260204 09:11:27.069079 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 125 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 125.
I20260204 09:11:27.069234 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 125 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:27.069319 10580 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 125 FOLLOWER]: Leader election won for term 125
I20260204 09:11:27.069399 10580 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 125 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:27.069450 10580 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 112, Committed index: 112, Last appended: 124.112, Last appended by leader: 112, Current term: 125, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:27.069852 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 124 to 125, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 125 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:27.088493 10572 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 125 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:27.088564 10572 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 125 FOLLOWER]: Advancing to term 126
I20260204 09:11:27.089121 10572 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 126 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:27.089264 10572 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 126 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:27.089448 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 126 candidate_status { last_received { term: 124 index: 112 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:27.089449 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 126 candidate_status { last_received { term: 124 index: 112 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:27.089557 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 125 FOLLOWER]: Advancing to term 126
I20260204 09:11:27.090077 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 126 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 126.
I20260204 09:11:27.090222 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 126 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:27.090305 10572 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 126 FOLLOWER]: Leader election won for term 126
I20260204 09:11:27.090376 10572 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 126 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:27.090428 10572 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 112, Committed index: 112, Last appended: 124.112, Last appended by leader: 112, Current term: 126, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:27.090862 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 125 to 126, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 126 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:27.169088 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 126 LEADER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 125. Current term is 126. Ops: []
I20260204 09:11:27.169375 10580 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 113, Last known committed idx: 112, Time since last communication: 0.000s
I20260204 09:11:27.169481 10580 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer 11502cf05241427fb9853e628add7746 log is divergent from this leader: its last log entry 126.113 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 112
I20260204 09:11:27.169518 10584 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 125 LEADER]: Stepping down as leader of term 125
I20260204 09:11:27.169555 10584 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 125 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:27.169616 10584 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 112, Committed index: 112, Last appended: 125.113, Last appended by leader: 113, Current term: 125, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:27.169692 10584 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 125 FOLLOWER]: Advancing to term 126
I20260204 09:11:27.197751 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 126 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 124 index: 112. Preceding OpId from leader: term: 126 index: 113. (index mismatch)
I20260204 09:11:27.198016 10572 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 113, Last known committed idx: 112, Time since last communication: 0.000s
I20260204 09:11:27.198954 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 126 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 125 index: 113. Preceding OpId from leader: term: 126 index: 113. (term mismatch)
I20260204 09:11:27.199098 10322 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Aborting all ops after (but not including) 112
I20260204 09:11:27.199131 10322 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: Aborting uncommitted NO_OP operation due to leader change: 125.113
I20260204 09:11:27.199151 10322 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 126 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:27.199290 10572 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 113, Last known committed idx: 112, Time since last communication: 0.000s
I20260204 09:11:27.299218 10585 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 126 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:27.299291 10585 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 126 FOLLOWER]: Advancing to term 127
I20260204 09:11:27.299929 10585 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 127 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:27.300104 10585 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 127 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:27.300285 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 127 candidate_status { last_received { term: 126 index: 113 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:27.300349 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 126 FOLLOWER]: Advancing to term 127
I20260204 09:11:27.300290 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 127 candidate_status { last_received { term: 126 index: 113 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:27.300886 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 127 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 127.
I20260204 09:11:27.301040 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 127 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:27.301128 10585 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 127 FOLLOWER]: Leader election won for term 127
I20260204 09:11:27.301180 10585 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 127 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:27.301236 10585 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 113, Committed index: 113, Last appended: 126.113, Last appended by leader: 113, Current term: 127, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:27.301630 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 126 to 127, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 127 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:27.306300 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 127 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 126. Current term is 127. Ops: []
I20260204 09:11:27.306489 10586 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 126.113, Next index: 114, Last known committed idx: 113, Time since last communication: 0.000s
I20260204 09:11:27.306586 10586 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 126 LEADER]: Stepping down as leader of term 126
I20260204 09:11:27.306622 10586 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 126 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:27.306675 10586 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 113, Committed index: 113, Last appended: 126.113, Last appended by leader: 113, Current term: 126, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:27.306751 10586 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 126 FOLLOWER]: Advancing to term 127
I20260204 09:11:27.394026 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 127 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 126 index: 113. Preceding OpId from leader: term: 127 index: 114. (index mismatch)
I20260204 09:11:27.394268 10585 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 114, Last known committed idx: 113, Time since last communication: 0.000s
I20260204 09:11:27.395185 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 127 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 126 index: 113. Preceding OpId from leader: term: 127 index: 114. (index mismatch)
I20260204 09:11:27.395411 10587 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 114, Last known committed idx: 113, Time since last communication: 0.000s
I20260204 09:11:27.592532 10584 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 127 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:27.592617 10584 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 127 FOLLOWER]: Advancing to term 128
I20260204 09:11:27.593257 10584 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 128 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:27.593439 10584 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 128 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:27.593658 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 128 candidate_status { last_received { term: 127 index: 114 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:27.593667 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 128 candidate_status { last_received { term: 127 index: 114 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:27.593912 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 128 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:27.594008 10584 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 128 FOLLOWER]: Leader election lost for term 128. Reason: could not achieve majority
I20260204 09:11:27.596597 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 128 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 127. Current term is 128. Ops: []
I20260204 09:11:27.596803 10587 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 127.114, Next index: 115, Last known committed idx: 114, Time since last communication: 0.000s
I20260204 09:11:27.596903 10587 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 127 LEADER]: Stepping down as leader of term 127
I20260204 09:11:27.596935 10587 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 127 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:27.596990 10587 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 114, Committed index: 114, Last appended: 127.114, Last appended by leader: 114, Current term: 127, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:27.597069 10587 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 127 FOLLOWER]: Advancing to term 128
I20260204 09:11:27.658083 10586 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 127 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:27.658190 10586 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 127 FOLLOWER]: Advancing to term 128
I20260204 09:11:27.659070 10586 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 128 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:27.659264 10586 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 128 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:27.659458 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 128 candidate_status { last_received { term: 127 index: 114 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:27.659459 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 128 candidate_status { last_received { term: 127 index: 114 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:27.659582 10322 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 128 FOLLOWER]: Leader election vote request: Denying vote to candidate 11502cf05241427fb9853e628add7746 in current term 128: Already voted for candidate bd38b0e96f264071a69be73b6b4f14c1 in this term.
I20260204 09:11:27.660127 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 128 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 128.
I20260204 09:11:27.660298 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 128 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:27.660380 10586 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 128 FOLLOWER]: Leader election won for term 128
I20260204 09:11:27.660429 10586 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 128 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:27.660512 10586 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 114, Committed index: 114, Last appended: 127.114, Last appended by leader: 114, Current term: 128, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:27.660969 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 127 to 128, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 128 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:27.709964 10584 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 128 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:27.710049 10584 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 128 FOLLOWER]: Advancing to term 129
I20260204 09:11:27.710670 10584 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 129 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:27.710824 10584 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 129 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:27.711033 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 129 candidate_status { last_received { term: 127 index: 114 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:27.711033 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 129 candidate_status { last_received { term: 127 index: 114 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:27.711151 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 128 FOLLOWER]: Advancing to term 129
I20260204 09:11:27.711710 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 129 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 129.
I20260204 09:11:27.711872 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 129 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:27.711958 10584 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 129 FOLLOWER]: Leader election won for term 129
I20260204 09:11:27.712080 10584 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 129 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:27.712138 10584 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 114, Committed index: 114, Last appended: 127.114, Last appended by leader: 114, Current term: 129, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:27.712553 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 128 to 129, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 129 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:27.766595 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 129 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 128. Current term is 129. Ops: []
I20260204 09:11:27.766821 10586 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 115, Last known committed idx: 114, Time since last communication: 0.000s
I20260204 09:11:27.766930 10586 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 128 LEADER]: Stepping down as leader of term 128
I20260204 09:11:27.766963 10586 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 128 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:27.767010 10586 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 114, Committed index: 114, Last appended: 128.115, Last appended by leader: 115, Current term: 128, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:27.767076 10586 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 128 FOLLOWER]: Advancing to term 129
I20260204 09:11:27.802066 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 129 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 128 index: 115. Preceding OpId from leader: term: 129 index: 115. (term mismatch)
I20260204 09:11:27.802139 10246 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting all ops after (but not including) 114
I20260204 09:11:27.802152 10246 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting uncommitted NO_OP operation due to leader change: 128.115
I20260204 09:11:27.802165 10246 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 129 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:27.802374 10584 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 115, Last known committed idx: 114, Time since last communication: 0.000s
I20260204 09:11:27.803323 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 129 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 127 index: 114. Preceding OpId from leader: term: 129 index: 115. (index mismatch)
I20260204 09:11:27.803468 10588 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 115, Last known committed idx: 114, Time since last communication: 0.000s
I20260204 09:11:27.904495 10587 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 129 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:27.904578 10587 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 129 FOLLOWER]: Advancing to term 130
I20260204 09:11:27.905225 10587 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 130 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:27.905421 10587 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 130 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:27.905570 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 130 candidate_status { last_received { term: 129 index: 115 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:27.905630 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 130 candidate_status { last_received { term: 129 index: 115 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:27.905857 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 130 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:27.905946 10587 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 130 FOLLOWER]: Leader election lost for term 130. Reason: could not achieve majority
I20260204 09:11:27.918057 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 130 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 129. Current term is 130. Ops: []
I20260204 09:11:27.918273 10588 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 129.115, Next index: 116, Last known committed idx: 115, Time since last communication: 0.000s
I20260204 09:11:27.918386 10584 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 129 LEADER]: Stepping down as leader of term 129
I20260204 09:11:27.918424 10584 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 129 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:27.918476 10584 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 115, Committed index: 115, Last appended: 129.115, Last appended by leader: 115, Current term: 129, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:27.918551 10584 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 129 FOLLOWER]: Advancing to term 130
I20260204 09:11:27.986997 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:28.001078 10586 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 129 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:28.001163 10586 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 129 FOLLOWER]: Advancing to term 130
I20260204 09:11:28.001870 10586 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 130 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:28.002045 10586 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 130 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:28.002228 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 130 candidate_status { last_received { term: 129 index: 115 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:28.002240 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 130 candidate_status { last_received { term: 129 index: 115 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:28.002348 10397 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 130 FOLLOWER]: Leader election vote request: Denying vote to candidate 11502cf05241427fb9853e628add7746 in current term 130: Already voted for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in this term.
I20260204 09:11:28.002843 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 130 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 130.
I20260204 09:11:28.003005 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 130 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:28.003088 10586 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 130 FOLLOWER]: Leader election won for term 130
I20260204 09:11:28.003145 10586 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 130 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:28.003202 10586 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 115, Committed index: 115, Last appended: 129.115, Last appended by leader: 115, Current term: 130, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:28.003602 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 129 to 130, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 130 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:28.015450 10587 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 130 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:28.015525 10587 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 130 FOLLOWER]: Advancing to term 131
I20260204 09:11:28.016096 10587 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 131 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:28.016227 10587 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 131 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:28.016392 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 131 candidate_status { last_received { term: 129 index: 115 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:28.016392 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 131 candidate_status { last_received { term: 129 index: 115 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:28.016492 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 130 FOLLOWER]: Advancing to term 131
I20260204 09:11:28.017012 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 131 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 131.
I20260204 09:11:28.017158 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 131 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:28.017254 10587 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 131 FOLLOWER]: Leader election won for term 131
I20260204 09:11:28.017304 10587 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 131 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:28.017338 10587 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 115, Committed index: 115, Last appended: 129.115, Last appended by leader: 115, Current term: 131, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:28.017745 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 130 to 131, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 131 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:28.104108 10246 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 130 LEADER]: Stepping down as leader of term 130
I20260204 09:11:28.104182 10246 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 130 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:28.104231 10246 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 115, Committed index: 115, Last appended: 130.116, Last appended by leader: 116, Current term: 130, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:28.104314 10246 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 130 FOLLOWER]: Advancing to term 131
I20260204 09:11:28.104998 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 131 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 130 index: 116. Preceding OpId from leader: term: 131 index: 116. (term mismatch)
I20260204 09:11:28.105050 10246 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting all ops after (but not including) 115
I20260204 09:11:28.105067 10246 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting uncommitted NO_OP operation due to leader change: 130.116
I20260204 09:11:28.105093 10246 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 131 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:28.105296 10587 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 116, Last known committed idx: 115, Time since last communication: 0.000s
I20260204 09:11:28.106185 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 131 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 129 index: 115. Preceding OpId from leader: term: 131 index: 116. (index mismatch)
I20260204 09:11:28.106343 10587 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 116, Last known committed idx: 115, Time since last communication: 0.000s
I20260204 09:11:28.389485 10584 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 131 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:28.389580 10584 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 131 FOLLOWER]: Advancing to term 132
I20260204 09:11:28.390223 10584 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 132 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:28.390381 10584 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 132 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:28.390588 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 132 candidate_status { last_received { term: 131 index: 116 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:28.390601 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 132 candidate_status { last_received { term: 131 index: 116 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:28.390846 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 132 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:28.390944 10584 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 132 FOLLOWER]: Leader election lost for term 132. Reason: could not achieve majority
I20260204 09:11:28.410270 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 132 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 131. Current term is 132. Ops: []
I20260204 09:11:28.410528 10590 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 131.116, Next index: 117, Last known committed idx: 116, Time since last communication: 0.000s
I20260204 09:11:28.410655 10590 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 131 LEADER]: Stepping down as leader of term 131
I20260204 09:11:28.410688 10590 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 131 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:28.410753 10590 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 116, Committed index: 116, Last appended: 131.116, Last appended by leader: 116, Current term: 131, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:28.410837 10590 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 131 FOLLOWER]: Advancing to term 132
I20260204 09:11:28.413899 10586 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 131 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:28.413949 10586 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 131 FOLLOWER]: Advancing to term 132
I20260204 09:11:28.414465 10586 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 132 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:28.414599 10586 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 132 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:28.414773 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 132 candidate_status { last_received { term: 131 index: 116 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:28.414778 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 132 candidate_status { last_received { term: 131 index: 116 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:28.414856 10322 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 132 FOLLOWER]: Leader election vote request: Denying vote to candidate 11502cf05241427fb9853e628add7746 in current term 132: Already voted for candidate bd38b0e96f264071a69be73b6b4f14c1 in this term.
I20260204 09:11:28.415354 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 132 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 132.
I20260204 09:11:28.415508 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 132 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:28.415601 10586 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 132 FOLLOWER]: Leader election won for term 132
I20260204 09:11:28.415669 10586 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 132 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:28.415704 10586 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 116, Committed index: 116, Last appended: 131.116, Last appended by leader: 116, Current term: 132, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:28.416136 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 131 to 132, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 132 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:28.502468 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 132 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 131 index: 116. Preceding OpId from leader: term: 132 index: 117. (index mismatch)
I20260204 09:11:28.502705 10586 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 117, Last known committed idx: 116, Time since last communication: 0.000s
I20260204 09:11:28.503769 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 132 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 131 index: 116. Preceding OpId from leader: term: 132 index: 117. (index mismatch)
I20260204 09:11:28.503959 10591 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 117, Last known committed idx: 116, Time since last communication: 0.000s
I20260204 09:11:28.605057 10584 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 132 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:28.605157 10584 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 132 FOLLOWER]: Advancing to term 133
I20260204 09:11:28.605926 10584 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 133 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:28.606087 10584 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 133 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:28.606292 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 133 candidate_status { last_received { term: 132 index: 117 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:28.606324 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 133 candidate_status { last_received { term: 132 index: 117 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:28.606377 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 132 FOLLOWER]: Advancing to term 133
I20260204 09:11:28.606959 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 133 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 133.
I20260204 09:11:28.607112 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 133 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:28.607197 10584 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 133 FOLLOWER]: Leader election won for term 133
I20260204 09:11:28.607290 10584 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 133 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:28.607336 10584 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 117, Committed index: 117, Last appended: 132.117, Last appended by leader: 117, Current term: 133, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:28.607748 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 132 to 133, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 133 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:28.608794 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 133 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 132. Current term is 133. Ops: []
I20260204 09:11:28.608978 10591 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 132.117, Next index: 118, Last known committed idx: 117, Time since last communication: 0.000s
I20260204 09:11:28.609056 10591 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 132 LEADER]: Stepping down as leader of term 132
I20260204 09:11:28.609086 10591 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 132 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:28.609143 10591 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 117, Committed index: 117, Last appended: 132.117, Last appended by leader: 117, Current term: 132, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:28.609211 10591 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 132 FOLLOWER]: Advancing to term 133
I20260204 09:11:28.705081 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 133 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 132 index: 117. Preceding OpId from leader: term: 133 index: 118. (index mismatch)
I20260204 09:11:28.705331 10584 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 118, Last known committed idx: 117, Time since last communication: 0.000s
I20260204 09:11:28.706445 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 133 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 132 index: 117. Preceding OpId from leader: term: 133 index: 118. (index mismatch)
I20260204 09:11:28.706684 10593 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 118, Last known committed idx: 117, Time since last communication: 0.000s
I20260204 09:11:28.807415 10590 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 133 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:28.807529 10590 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 133 FOLLOWER]: Advancing to term 134
I20260204 09:11:28.808187 10590 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 134 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:28.808357 10590 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 134 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:28.808578 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 134 candidate_status { last_received { term: 133 index: 118 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:28.808578 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 134 candidate_status { last_received { term: 133 index: 118 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:28.808878 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 134 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:28.808970 10590 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 134 FOLLOWER]: Leader election lost for term 134. Reason: could not achieve majority
I20260204 09:11:28.816524 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 134 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 133. Current term is 134. Ops: []
I20260204 09:11:28.816771 10593 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 133.118, Next index: 119, Last known committed idx: 118, Time since last communication: 0.000s
I20260204 09:11:28.816879 10593 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 133 LEADER]: Stepping down as leader of term 133
I20260204 09:11:28.816907 10593 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 133 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:28.816969 10593 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 118, Committed index: 118, Last appended: 133.118, Last appended by leader: 118, Current term: 133, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:28.817052 10593 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 133 FOLLOWER]: Advancing to term 134
I20260204 09:11:28.886848 10591 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 133 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:28.886981 10591 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 133 FOLLOWER]: Advancing to term 134
I20260204 09:11:28.887784 10591 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 134 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:28.887974 10591 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 134 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:28.888154 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 134 candidate_status { last_received { term: 133 index: 118 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:28.888157 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 134 candidate_status { last_received { term: 133 index: 118 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:28.888302 10397 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 134 FOLLOWER]: Leader election vote request: Denying vote to candidate 11502cf05241427fb9853e628add7746 in current term 134: Already voted for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in this term.
I20260204 09:11:28.888789 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 134 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 134.
I20260204 09:11:28.888967 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 134 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:28.889045 10591 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 134 FOLLOWER]: Leader election won for term 134
I20260204 09:11:28.889125 10591 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 134 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:28.889180 10591 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 118, Committed index: 118, Last appended: 133.118, Last appended by leader: 118, Current term: 134, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:28.889775 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 133 to 134, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 134 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:28.935354 10590 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 134 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:28.935446 10590 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 134 FOLLOWER]: Advancing to term 135
I20260204 09:11:28.936101 10590 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 135 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:28.936343 10590 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 135 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:28.936537 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 135 candidate_status { last_received { term: 133 index: 118 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:28.936549 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 135 candidate_status { last_received { term: 133 index: 118 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:28.936661 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 134 FOLLOWER]: Advancing to term 135
I20260204 09:11:28.937225 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 135 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 135.
I20260204 09:11:28.937412 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 135 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:28.937501 10590 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 135 FOLLOWER]: Leader election won for term 135
I20260204 09:11:28.937650 10590 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 135 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:28.937700 10590 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 118, Committed index: 118, Last appended: 133.118, Last appended by leader: 118, Current term: 135, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:28.938143 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 134 to 135, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 135 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:28.970022 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 135 LEADER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 134. Current term is 135. Ops: []
I20260204 09:11:28.970310 10591 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 119, Last known committed idx: 118, Time since last communication: 0.000s
I20260204 09:11:28.970418 10591 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer 8b12f9075d9d4ffa9fd711322da0c4d2 log is divergent from this leader: its last log entry 135.119 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 118
I20260204 09:11:28.970445 10586 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 134 LEADER]: Stepping down as leader of term 134
I20260204 09:11:28.970485 10586 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 134 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:28.970547 10586 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 118, Committed index: 118, Last appended: 134.119, Last appended by leader: 119, Current term: 134, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:28.970616 10586 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 134 FOLLOWER]: Advancing to term 135
I20260204 09:11:28.987221 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:29.031482 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 135 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 134 index: 119. Preceding OpId from leader: term: 135 index: 119. (term mismatch)
I20260204 09:11:29.031558 10246 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting all ops after (but not including) 118
I20260204 09:11:29.031570 10246 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting uncommitted NO_OP operation due to leader change: 134.119
I20260204 09:11:29.031584 10246 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 135 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:29.031785 10590 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 119, Last known committed idx: 118, Time since last communication: 0.000s
I20260204 09:11:29.032968 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 135 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 133 index: 118. Preceding OpId from leader: term: 135 index: 119. (index mismatch)
I20260204 09:11:29.033138 10595 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 119, Last known committed idx: 118, Time since last communication: 0.000s
I20260204 09:11:29.134119 10592 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 135 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:29.134243 10592 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 135 FOLLOWER]: Advancing to term 136
I20260204 09:11:29.135218 10592 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 136 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:29.135437 10592 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 136 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:29.135609 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 136 candidate_status { last_received { term: 135 index: 119 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:29.135680 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 136 candidate_status { last_received { term: 135 index: 119 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:29.135775 10246 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 135 FOLLOWER]: Advancing to term 136
I20260204 09:11:29.136492 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 136 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 136.
I20260204 09:11:29.136655 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 136 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:29.136744 10592 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 136 FOLLOWER]: Leader election won for term 136
I20260204 09:11:29.136798 10592 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 136 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:29.136853 10592 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 119, Committed index: 119, Last appended: 135.119, Last appended by leader: 119, Current term: 136, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:29.137228 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 135 to 136, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 136 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:29.139072 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 136 LEADER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 135. Current term is 136. Ops: []
I20260204 09:11:29.139245 10590 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 135.119, Next index: 120, Last known committed idx: 119, Time since last communication: 0.000s
I20260204 09:11:29.139328 10590 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer bd38b0e96f264071a69be73b6b4f14c1 log is divergent from this leader: its last log entry 136.120 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 119
I20260204 09:11:29.139364 10594 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 135 LEADER]: Stepping down as leader of term 135
I20260204 09:11:29.139398 10594 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 135 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:29.139451 10594 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 119, Committed index: 119, Last appended: 135.119, Last appended by leader: 119, Current term: 135, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:29.139526 10594 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 135 FOLLOWER]: Advancing to term 136
I20260204 09:11:29.214582 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 136 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 135 index: 119. Preceding OpId from leader: term: 136 index: 120. (index mismatch)
I20260204 09:11:29.214840 10592 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 120, Last known committed idx: 119, Time since last communication: 0.000s
I20260204 09:11:29.215818 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 136 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 135 index: 119. Preceding OpId from leader: term: 136 index: 120. (index mismatch)
I20260204 09:11:29.215976 10592 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 120, Last known committed idx: 119, Time since last communication: 0.000s
I20260204 09:11:29.495010 10586 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 136 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:29.495110 10586 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 136 FOLLOWER]: Advancing to term 137
I20260204 09:11:29.495718 10586 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 137 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:29.495878 10586 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 137 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:29.496084 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 137 candidate_status { last_received { term: 136 index: 120 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:29.496084 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 137 candidate_status { last_received { term: 136 index: 120 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:29.496315 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 137 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11502cf05241427fb9853e628add7746; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:29.496421 10586 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 137 FOLLOWER]: Leader election lost for term 137. Reason: could not achieve majority
I20260204 09:11:29.504956 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 137 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 136. Current term is 137. Ops: []
I20260204 09:11:29.505194 10584 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 136.120, Next index: 121, Last known committed idx: 120, Time since last communication: 0.000s
I20260204 09:11:29.505303 10584 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 136 LEADER]: Stepping down as leader of term 136
I20260204 09:11:29.505334 10584 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 136 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:29.505422 10584 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 120, Committed index: 120, Last appended: 136.120, Last appended by leader: 120, Current term: 136, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:29.505498 10584 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 136 FOLLOWER]: Advancing to term 137
I20260204 09:11:29.507306 10594 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 136 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:29.507355 10594 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 136 FOLLOWER]: Advancing to term 137
I20260204 09:11:29.507871 10594 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 137 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:29.507993 10594 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 137 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:29.508147 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 137 candidate_status { last_received { term: 136 index: 120 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:29.508153 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 137 candidate_status { last_received { term: 136 index: 120 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:29.508224 10246 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 137 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in current term 137: Already voted for candidate 11502cf05241427fb9853e628add7746 in this term.
I20260204 09:11:29.508695 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 137 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 137.
I20260204 09:11:29.508843 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 137 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:29.508929 10594 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 137 FOLLOWER]: Leader election won for term 137
I20260204 09:11:29.508980 10594 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 137 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:29.509039 10594 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 120, Committed index: 120, Last appended: 136.120, Last appended by leader: 120, Current term: 137, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:29.509439 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 136 to 137, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 137 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:29.606793 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 137 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 136 index: 120. Preceding OpId from leader: term: 137 index: 121. (index mismatch)
I20260204 09:11:29.607060 10594 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 121, Last known committed idx: 120, Time since last communication: 0.000s
I20260204 09:11:29.608116 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 137 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 136 index: 120. Preceding OpId from leader: term: 137 index: 121. (index mismatch)
I20260204 09:11:29.608319 10594 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 121, Last known committed idx: 120, Time since last communication: 0.000s
I20260204 09:11:29.708956 10596 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 137 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:29.709045 10596 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 137 FOLLOWER]: Advancing to term 138
I20260204 09:11:29.709786 10596 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 138 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:29.709947 10596 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 138 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:29.710127 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 138 candidate_status { last_received { term: 137 index: 121 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:29.710192 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 137 FOLLOWER]: Advancing to term 138
I20260204 09:11:29.710131 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 138 candidate_status { last_received { term: 137 index: 121 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:29.710745 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 138 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 138.
I20260204 09:11:29.710907 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 138 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:29.710989 10596 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 138 FOLLOWER]: Leader election won for term 138
I20260204 09:11:29.711050 10596 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 138 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:29.711103 10596 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 121, Committed index: 121, Last appended: 137.121, Last appended by leader: 121, Current term: 138, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:29.711495 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 137 to 138, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 138 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:29.712378 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 138 LEADER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 137. Current term is 138. Ops: []
I20260204 09:11:29.712538 10595 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 137.121, Next index: 122, Last known committed idx: 121, Time since last communication: 0.000s
I20260204 09:11:29.712618 10595 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer 11502cf05241427fb9853e628add7746 log is divergent from this leader: its last log entry 138.122 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 121
I20260204 09:11:29.712659 10590 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 137 LEADER]: Stepping down as leader of term 137
I20260204 09:11:29.712695 10590 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 137 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:29.712739 10590 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 121, Committed index: 121, Last appended: 137.121, Last appended by leader: 121, Current term: 137, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:29.712795 10590 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 137 FOLLOWER]: Advancing to term 138
I20260204 09:11:29.818944 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 138 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 137 index: 121. Preceding OpId from leader: term: 138 index: 122. (index mismatch)
I20260204 09:11:29.819232 10596 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 122, Last known committed idx: 121, Time since last communication: 0.000s
I20260204 09:11:29.820237 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 138 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 137 index: 121. Preceding OpId from leader: term: 138 index: 122. (index mismatch)
I20260204 09:11:29.820444 10596 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 122, Last known committed idx: 121, Time since last communication: 0.000s
I20260204 09:11:29.921252 10593 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 138 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:29.921368 10593 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 138 FOLLOWER]: Advancing to term 139
I20260204 09:11:29.922055 10593 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 139 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:29.922194 10593 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 139 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:29.922418 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 139 candidate_status { last_received { term: 138 index: 122 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:29.922418 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 139 candidate_status { last_received { term: 138 index: 122 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:29.922555 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 138 FOLLOWER]: Advancing to term 139
I20260204 09:11:29.923117 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 139 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 139.
I20260204 09:11:29.923296 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 139 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:29.923385 10593 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 139 FOLLOWER]: Leader election won for term 139
I20260204 09:11:29.923449 10593 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 139 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:29.923492 10593 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 122, Committed index: 122, Last appended: 138.122, Last appended by leader: 122, Current term: 139, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:29.923902 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 138 to 139, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 139 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:29.941099 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 139 LEADER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 138. Current term is 139. Ops: []
I20260204 09:11:29.941335 10597 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 138.122, Next index: 123, Last known committed idx: 122, Time since last communication: 0.000s
I20260204 09:11:29.941466 10597 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer bd38b0e96f264071a69be73b6b4f14c1 log is divergent from this leader: its last log entry 139.123 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 122
I20260204 09:11:29.941495 10586 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 138 LEADER]: Stepping down as leader of term 138
I20260204 09:11:29.941574 10586 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 138 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:29.941628 10586 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 122, Committed index: 122, Last appended: 138.122, Last appended by leader: 122, Current term: 138, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:29.941720 10586 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 138 FOLLOWER]: Advancing to term 139
I20260204 09:11:29.987455 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:30.009382 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 139 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 138 index: 122. Preceding OpId from leader: term: 139 index: 123. (index mismatch)
I20260204 09:11:30.009649 10593 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 123, Last known committed idx: 122, Time since last communication: 0.000s
I20260204 09:11:30.010599 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 139 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 138 index: 122. Preceding OpId from leader: term: 139 index: 123. (index mismatch)
I20260204 09:11:30.010751 10593 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 123, Last known committed idx: 122, Time since last communication: 0.000s
I20260204 09:11:30.382540 10590 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 139 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:30.382637 10590 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 139 FOLLOWER]: Advancing to term 140
I20260204 09:11:30.383316 10590 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 140 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:30.383479 10590 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 140 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:30.383680 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 140 candidate_status { last_received { term: 139 index: 123 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:30.383680 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 140 candidate_status { last_received { term: 139 index: 123 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:30.383988 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 140 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:30.384073 10590 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 140 FOLLOWER]: Leader election lost for term 140. Reason: could not achieve majority
I20260204 09:11:30.391508 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 140 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 139. Current term is 140. Ops: []
I20260204 09:11:30.391733 10598 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 139.123, Next index: 124, Last known committed idx: 123, Time since last communication: 0.000s
I20260204 09:11:30.391865 10584 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 139 LEADER]: Stepping down as leader of term 139
I20260204 09:11:30.391906 10584 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 139 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:30.391955 10584 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 123, Committed index: 123, Last appended: 139.123, Last appended by leader: 123, Current term: 139, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:30.392037 10584 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 139 FOLLOWER]: Advancing to term 140
I20260204 09:11:30.415668 10586 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 139 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:30.415750 10586 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 139 FOLLOWER]: Advancing to term 140
I20260204 09:11:30.416359 10586 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 140 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:30.416522 10586 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 140 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:30.416723 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 140 candidate_status { last_received { term: 139 index: 123 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:30.416729 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 140 candidate_status { last_received { term: 139 index: 123 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:30.416806 10397 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 140 FOLLOWER]: Leader election vote request: Denying vote to candidate 11502cf05241427fb9853e628add7746 in current term 140: Already voted for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in this term.
I20260204 09:11:30.417337 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 140 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 140.
I20260204 09:11:30.417510 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 140 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:30.417595 10586 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 140 FOLLOWER]: Leader election won for term 140
I20260204 09:11:30.417647 10586 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 140 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:30.417681 10586 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 123, Committed index: 123, Last appended: 139.123, Last appended by leader: 123, Current term: 140, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:30.418111 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 139 to 140, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 140 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:30.494451 10590 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 140 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:30.494542 10590 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 140 FOLLOWER]: Advancing to term 141
I20260204 09:11:30.495198 10590 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 141 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:30.495416 10590 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 141 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:30.495443 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 140 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 139 index: 123. Preceding OpId from leader: term: 140 index: 124. (index mismatch)
I20260204 09:11:30.495494 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 141 candidate_status { last_received { term: 139 index: 123 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:30.495512 10321 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 141 candidate_status { last_received { term: 139 index: 123 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:30.495612 10321 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 140 FOLLOWER]: Advancing to term 141
I20260204 09:11:30.495707 10586 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 124, Last known committed idx: 123, Time since last communication: 0.000s
I20260204 09:11:30.496297 10321 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 141 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 141.
I20260204 09:11:30.496374 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 141 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 140. Current term is 141. Ops: [140.124-140.124]
I20260204 09:11:30.496474 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 141 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:30.496557 10590 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 141 FOLLOWER]: Leader election won for term 141
I20260204 09:11:30.496553 10586 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 139.123, Next index: 124, Last known committed idx: 123, Time since last communication: 0.000s
I20260204 09:11:30.496652 10586 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 140 LEADER]: Stepping down as leader of term 140
I20260204 09:11:30.496683 10586 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 140 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:30.496691 10590 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 141 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:30.496733 10586 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 123, Committed index: 123, Last appended: 140.124, Last appended by leader: 124, Current term: 140, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:30.496796 10586 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 140 FOLLOWER]: Advancing to term 141
I20260204 09:11:30.496776 10590 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 123, Committed index: 123, Last appended: 139.123, Last appended by leader: 123, Current term: 141, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:30.497206 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 140 to 141, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 141 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:30.594619 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 141 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 140 index: 124. Preceding OpId from leader: term: 141 index: 124. (term mismatch)
I20260204 09:11:30.594692 10246 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting all ops after (but not including) 123
I20260204 09:11:30.594705 10246 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting uncommitted NO_OP operation due to leader change: 140.124
I20260204 09:11:30.594719 10246 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 141 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:30.595005 10590 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 124, Last known committed idx: 123, Time since last communication: 0.000s
I20260204 09:11:30.595933 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 141 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 139 index: 123. Preceding OpId from leader: term: 141 index: 124. (index mismatch)
I20260204 09:11:30.596182 10599 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 124, Last known committed idx: 123, Time since last communication: 0.000s
I20260204 09:11:30.774849 10584 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 141 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:30.774945 10584 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 141 FOLLOWER]: Advancing to term 142
I20260204 09:11:30.775568 10584 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 142 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:30.775733 10584 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 142 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:30.775983 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 142 candidate_status { last_received { term: 141 index: 124 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:30.775986 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 142 candidate_status { last_received { term: 141 index: 124 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:30.776221 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 142 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:30.776310 10584 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 142 FOLLOWER]: Leader election lost for term 142. Reason: could not achieve majority
I20260204 09:11:30.798580 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 142 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 141. Current term is 142. Ops: []
I20260204 09:11:30.798840 10600 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 141.124, Next index: 125, Last known committed idx: 124, Time since last communication: 0.000s
I20260204 09:11:30.798967 10600 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 141 LEADER]: Stepping down as leader of term 141
I20260204 09:11:30.799001 10600 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 141 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:30.799057 10600 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 124, Committed index: 124, Last appended: 141.124, Last appended by leader: 124, Current term: 141, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:30.799135 10600 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 141 FOLLOWER]: Advancing to term 142
I20260204 09:11:30.802444 10586 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 141 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:30.802502 10586 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 141 FOLLOWER]: Advancing to term 142
I20260204 09:11:30.803063 10586 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 142 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:30.803202 10586 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 142 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:30.803350 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 142 candidate_status { last_received { term: 141 index: 124 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:30.803351 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 142 candidate_status { last_received { term: 141 index: 124 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:30.803454 10322 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 142 FOLLOWER]: Leader election vote request: Denying vote to candidate 11502cf05241427fb9853e628add7746 in current term 142: Already voted for candidate bd38b0e96f264071a69be73b6b4f14c1 in this term.
I20260204 09:11:30.803951 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 142 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 142.
I20260204 09:11:30.804105 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 142 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:30.804184 10586 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 142 FOLLOWER]: Leader election won for term 142
I20260204 09:11:30.804241 10586 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 142 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:30.804354 10586 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 124, Committed index: 124, Last appended: 141.124, Last appended by leader: 124, Current term: 142, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:30.804723 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 141 to 142, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 142 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:30.884182 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 142 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 141 index: 124. Preceding OpId from leader: term: 142 index: 125. (index mismatch)
I20260204 09:11:30.884431 10586 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 125, Last known committed idx: 124, Time since last communication: 0.000s
I20260204 09:11:30.885644 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 142 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 141 index: 124. Preceding OpId from leader: term: 142 index: 125. (index mismatch)
I20260204 09:11:30.885836 10586 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 125, Last known committed idx: 124, Time since last communication: 0.000s
I20260204 09:11:30.987705 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:31.077090 10584 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 142 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:31.077201 10584 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 142 FOLLOWER]: Advancing to term 143
I20260204 09:11:31.078075 10584 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 143 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:31.078250 10584 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 143 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:31.078450 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 143 candidate_status { last_received { term: 142 index: 125 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:31.078454 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 143 candidate_status { last_received { term: 142 index: 125 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:31.078688 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 143 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:31.078809 10584 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 143 FOLLOWER]: Leader election lost for term 143. Reason: could not achieve majority
I20260204 09:11:31.088621 10599 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 142 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:31.088701 10599 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 142 FOLLOWER]: Advancing to term 143
I20260204 09:11:31.088935 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 143 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 142. Current term is 143. Ops: []
I20260204 09:11:31.089134 10601 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 142.125, Next index: 126, Last known committed idx: 125, Time since last communication: 0.000s
I20260204 09:11:31.089251 10597 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 142 LEADER]: Stepping down as leader of term 142
I20260204 09:11:31.089298 10597 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 142 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:31.089399 10597 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 125, Committed index: 125, Last appended: 142.125, Last appended by leader: 125, Current term: 142, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:31.089496 10597 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 142 FOLLOWER]: Advancing to term 143
I20260204 09:11:31.089648 10599 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 143 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:31.089781 10599 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 143 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:31.089910 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 143 candidate_status { last_received { term: 142 index: 125 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:31.090003 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 143 candidate_status { last_received { term: 142 index: 125 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:31.090067 10322 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 143 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in current term 143: Already voted for candidate bd38b0e96f264071a69be73b6b4f14c1 in this term.
I20260204 09:11:31.090662 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 143 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 143.
I20260204 09:11:31.090818 10362 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 143 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:31.090929 10599 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 143 FOLLOWER]: Leader election won for term 143
I20260204 09:11:31.090982 10599 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 143 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:31.091027 10599 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 125, Committed index: 125, Last appended: 142.125, Last appended by leader: 125, Current term: 143, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:31.091415 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 142 to 143, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 143 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:31.182786 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 143 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 142 index: 125. Preceding OpId from leader: term: 143 index: 126. (index mismatch)
I20260204 09:11:31.183050 10599 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 126, Last known committed idx: 125, Time since last communication: 0.000s
I20260204 09:11:31.184383 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 143 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 142 index: 125. Preceding OpId from leader: term: 143 index: 126. (index mismatch)
I20260204 09:11:31.184598 10599 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 126, Last known committed idx: 125, Time since last communication: 0.000s
I20260204 09:11:31.441092 10597 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 143 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:31.441200 10597 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 143 FOLLOWER]: Advancing to term 144
I20260204 09:11:31.441917 10597 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 144 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:31.442072 10597 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 144 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:31.442276 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 144 candidate_status { last_received { term: 143 index: 126 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:31.442281 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 144 candidate_status { last_received { term: 143 index: 126 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:31.442512 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 144 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11502cf05241427fb9853e628add7746; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:31.442591 10597 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 144 FOLLOWER]: Leader election lost for term 144. Reason: could not achieve majority
I20260204 09:11:31.452811 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 144 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 143. Current term is 144. Ops: []
I20260204 09:11:31.453007 10602 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 143.126, Next index: 127, Last known committed idx: 126, Time since last communication: 0.000s
I20260204 09:11:31.453111 10600 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 143 LEADER]: Stepping down as leader of term 143
I20260204 09:11:31.453147 10600 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 143 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:31.453193 10600 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 126, Committed index: 126, Last appended: 143.126, Last appended by leader: 126, Current term: 143, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:31.453267 10600 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 143 FOLLOWER]: Advancing to term 144
I20260204 09:11:31.484849 10584 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 143 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:31.484939 10584 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 143 FOLLOWER]: Advancing to term 144
I20260204 09:11:31.485592 10584 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 144 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:31.485710 10584 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 144 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:31.485895 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 144 candidate_status { last_received { term: 143 index: 126 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:31.485910 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 144 candidate_status { last_received { term: 143 index: 126 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:31.485998 10246 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 144 FOLLOWER]: Leader election vote request: Denying vote to candidate bd38b0e96f264071a69be73b6b4f14c1 in current term 144: Already voted for candidate 11502cf05241427fb9853e628add7746 in this term.
I20260204 09:11:31.486541 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 144 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 144.
I20260204 09:11:31.486706 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 144 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:31.486794 10584 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 144 FOLLOWER]: Leader election won for term 144
I20260204 09:11:31.486884 10584 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 144 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:31.486925 10584 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 126, Committed index: 126, Last appended: 143.126, Last appended by leader: 126, Current term: 144, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:31.487339 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 143 to 144, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 144 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:31.567809 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 144 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 143 index: 126. Preceding OpId from leader: term: 144 index: 127. (index mismatch)
I20260204 09:11:31.568082 10584 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 127, Last known committed idx: 126, Time since last communication: 0.000s
I20260204 09:11:31.569077 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 144 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 143 index: 126. Preceding OpId from leader: term: 144 index: 127. (index mismatch)
I20260204 09:11:31.569314 10604 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 127, Last known committed idx: 126, Time since last communication: 0.000s
I20260204 09:11:31.669607 10597 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 144 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:31.669693 10597 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 144 FOLLOWER]: Advancing to term 145
I20260204 09:11:31.670316 10597 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 145 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:31.670451 10597 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 145 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:31.670603 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 145 candidate_status { last_received { term: 144 index: 127 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:31.670646 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 145 candidate_status { last_received { term: 144 index: 127 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:31.670845 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 145 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11502cf05241427fb9853e628add7746; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:31.670957 10597 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 145 FOLLOWER]: Leader election lost for term 145. Reason: could not achieve majority
I20260204 09:11:31.682161 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 145 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 144. Current term is 145. Ops: []
I20260204 09:11:31.682359 10603 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 144.127, Next index: 128, Last known committed idx: 127, Time since last communication: 0.000s
I20260204 09:11:31.682471 10584 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 144 LEADER]: Stepping down as leader of term 144
I20260204 09:11:31.682512 10584 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 144 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:31.682562 10584 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 127, Committed index: 127, Last appended: 144.127, Last appended by leader: 127, Current term: 144, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:31.682726 10584 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 144 FOLLOWER]: Advancing to term 145
I20260204 09:11:31.764820 10602 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 144 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:31.764909 10602 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 144 FOLLOWER]: Advancing to term 145
I20260204 09:11:31.765666 10602 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 145 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:31.765817 10602 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 145 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:31.766013 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 145 candidate_status { last_received { term: 144 index: 127 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:31.766022 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 145 candidate_status { last_received { term: 144 index: 127 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:31.766130 10246 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 145 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in current term 145: Already voted for candidate 11502cf05241427fb9853e628add7746 in this term.
I20260204 09:11:31.766690 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 145 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 145.
I20260204 09:11:31.766855 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 145 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:31.766934 10602 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 145 FOLLOWER]: Leader election won for term 145
I20260204 09:11:31.767014 10602 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 145 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:31.767068 10602 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 127, Committed index: 127, Last appended: 144.127, Last appended by leader: 127, Current term: 145, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:31.767484 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 144 to 145, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 145 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:31.773227 10597 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 145 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:31.773283 10597 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 145 FOLLOWER]: Advancing to term 146
I20260204 09:11:31.773862 10597 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 146 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:31.773988 10597 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 146 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:31.774127 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 146 candidate_status { last_received { term: 144 index: 127 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:31.774142 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 146 candidate_status { last_received { term: 144 index: 127 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:31.774202 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 145 FOLLOWER]: Advancing to term 146
I20260204 09:11:31.774698 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 146 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 146.
I20260204 09:11:31.774843 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 146 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:31.774923 10597 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 146 FOLLOWER]: Leader election won for term 146
I20260204 09:11:31.775031 10597 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 146 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:31.775068 10597 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 127, Committed index: 127, Last appended: 144.127, Last appended by leader: 127, Current term: 146, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:31.775413 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 145 to 146, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 146 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:31.842697 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 146 LEADER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 145. Current term is 146. Ops: []
I20260204 09:11:31.842964 10602 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 128, Last known committed idx: 127, Time since last communication: 0.000s
I20260204 09:11:31.843081 10602 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer 11502cf05241427fb9853e628add7746 log is divergent from this leader: its last log entry 146.128 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 127
I20260204 09:11:31.843114 10600 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 145 LEADER]: Stepping down as leader of term 145
I20260204 09:11:31.843163 10600 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 145 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:31.843221 10600 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 127, Committed index: 127, Last appended: 145.128, Last appended by leader: 128, Current term: 145, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:31.843312 10600 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 145 FOLLOWER]: Advancing to term 146
I20260204 09:11:31.858412 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 146 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 144 index: 127. Preceding OpId from leader: term: 146 index: 128. (index mismatch)
I20260204 09:11:31.858649 10597 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 128, Last known committed idx: 127, Time since last communication: 0.000s
I20260204 09:11:31.859521 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 146 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 145 index: 128. Preceding OpId from leader: term: 146 index: 128. (term mismatch)
I20260204 09:11:31.859566 10397 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2: Aborting all ops after (but not including) 127
I20260204 09:11:31.859584 10397 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2: Aborting uncommitted NO_OP operation due to leader change: 145.128
I20260204 09:11:31.859601 10397 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 146 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:31.859788 10597 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 128, Last known committed idx: 127, Time since last communication: 0.000s
I20260204 09:11:31.960060 10584 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 146 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:31.960162 10584 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 146 FOLLOWER]: Advancing to term 147
I20260204 09:11:31.960840 10584 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 147 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:31.960997 10584 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 147 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:31.961251 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 147 candidate_status { last_received { term: 146 index: 128 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:31.961310 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 147 candidate_status { last_received { term: 146 index: 128 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:31.961311 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 146 FOLLOWER]: Advancing to term 147
I20260204 09:11:31.962147 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 147 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 147.
I20260204 09:11:31.962311 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 147 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:31.962400 10584 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 147 FOLLOWER]: Leader election won for term 147
I20260204 09:11:31.962452 10584 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 147 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:31.962500 10584 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 128, Committed index: 128, Last appended: 146.128, Last appended by leader: 128, Current term: 147, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:31.962930 10142 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 146 to 147, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 147 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:31.980304 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 147 LEADER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 146. Current term is 147. Ops: []
I20260204 09:11:31.980602 10597 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 146.128, Next index: 129, Last known committed idx: 128, Time since last communication: 0.000s
I20260204 09:11:31.980736 10597 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer bd38b0e96f264071a69be73b6b4f14c1 log is divergent from this leader: its last log entry 147.129 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 128
I20260204 09:11:31.980813 10605 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 146 LEADER]: Stepping down as leader of term 146
I20260204 09:11:31.980854 10605 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 146 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:31.980918 10605 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 128, Committed index: 128, Last appended: 146.128, Last appended by leader: 128, Current term: 146, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:31.981014 10605 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 146 FOLLOWER]: Advancing to term 147
I20260204 09:11:31.987933 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:32.039240 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 147 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 146 index: 128. Preceding OpId from leader: term: 147 index: 129. (index mismatch)
I20260204 09:11:32.039537 10584 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 129, Last known committed idx: 128, Time since last communication: 0.000s
I20260204 09:11:32.040560 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 147 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 146 index: 128. Preceding OpId from leader: term: 147 index: 129. (index mismatch)
I20260204 09:11:32.040725 10584 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 129, Last known committed idx: 128, Time since last communication: 0.000s
I20260204 09:11:32.141031 10600 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 147 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:32.141122 10600 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 147 FOLLOWER]: Advancing to term 148
I20260204 09:11:32.141817 10600 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 148 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:32.141979 10600 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 148 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:32.142192 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 148 candidate_status { last_received { term: 147 index: 129 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:32.142196 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 148 candidate_status { last_received { term: 147 index: 129 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:32.142504 10362 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 148 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:32.142618 10600 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 148 FOLLOWER]: Leader election lost for term 148. Reason: could not achieve majority
I20260204 09:11:32.145704 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 148 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 147. Current term is 148. Ops: []
I20260204 09:11:32.145896 10603 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 147.129, Next index: 130, Last known committed idx: 129, Time since last communication: 0.000s
I20260204 09:11:32.145988 10584 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 147 LEADER]: Stepping down as leader of term 147
I20260204 09:11:32.146028 10584 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 147 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:32.146077 10584 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 129, Committed index: 129, Last appended: 147.129, Last appended by leader: 129, Current term: 147, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:32.146153 10584 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 147 FOLLOWER]: Advancing to term 148
I20260204 09:11:32.219746 10605 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 147 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:32.219857 10605 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 147 FOLLOWER]: Advancing to term 148
I20260204 09:11:32.220551 10605 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 148 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:32.220743 10605 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 148 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:32.220921 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 148 candidate_status { last_received { term: 147 index: 129 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:32.220937 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 148 candidate_status { last_received { term: 147 index: 129 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:32.221040 10397 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 148 FOLLOWER]: Leader election vote request: Denying vote to candidate 11502cf05241427fb9853e628add7746 in current term 148: Already voted for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in this term.
I20260204 09:11:32.221632 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 148 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 148.
I20260204 09:11:32.221809 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 148 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:32.221905 10605 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 148 FOLLOWER]: Leader election won for term 148
I20260204 09:11:32.221982 10605 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 148 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:32.222030 10605 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 129, Committed index: 129, Last appended: 147.129, Last appended by leader: 129, Current term: 148, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:32.222522 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 147 to 148, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 148 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:32.246376 10600 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 148 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:32.246469 10600 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 148 FOLLOWER]: Advancing to term 149
I20260204 09:11:32.247114 10600 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 149 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:32.247277 10600 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 149 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:32.247516 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 149 candidate_status { last_received { term: 147 index: 129 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:32.247527 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 149 candidate_status { last_received { term: 147 index: 129 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:32.247659 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 148 FOLLOWER]: Advancing to term 149
I20260204 09:11:32.248198 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 149 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 149.
I20260204 09:11:32.248381 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 149 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:32.248495 10600 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 149 FOLLOWER]: Leader election won for term 149
I20260204 09:11:32.248586 10600 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 149 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:32.248647 10600 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 129, Committed index: 129, Last appended: 147.129, Last appended by leader: 129, Current term: 149, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:32.249101 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 148 to 149, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 149 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:32.297731 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 149 LEADER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 148. Current term is 149. Ops: []
I20260204 09:11:32.297981 10605 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 0.0, Next index: 130, Last known committed idx: 129, Time since last communication: 0.000s
I20260204 09:11:32.298102 10605 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer 8b12f9075d9d4ffa9fd711322da0c4d2 log is divergent from this leader: its last log entry 149.130 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 129
I20260204 09:11:32.298142 10597 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 148 LEADER]: Stepping down as leader of term 148
I20260204 09:11:32.298194 10597 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 148 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:32.298267 10597 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 129, Committed index: 129, Last appended: 148.130, Last appended by leader: 130, Current term: 148, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:32.298344 10597 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 148 FOLLOWER]: Advancing to term 149
I20260204 09:11:32.325495 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 149 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 148 index: 130. Preceding OpId from leader: term: 149 index: 130. (term mismatch)
I20260204 09:11:32.325574 10246 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting all ops after (but not including) 129
I20260204 09:11:32.325592 10246 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting uncommitted NO_OP operation due to leader change: 148.130
I20260204 09:11:32.325609 10246 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 149 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:32.325927 10600 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 130, Last known committed idx: 129, Time since last communication: 0.000s
I20260204 09:11:32.327112 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 149 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 147 index: 129. Preceding OpId from leader: term: 149 index: 130. (index mismatch)
I20260204 09:11:32.327311 10606 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 130, Last known committed idx: 129, Time since last communication: 0.000s
I20260204 09:11:32.513622 10584 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 149 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:32.513743 10584 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 149 FOLLOWER]: Advancing to term 150
I20260204 09:11:32.514420 10584 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 150 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:32.514655 10584 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 150 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:32.514904 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 150 candidate_status { last_received { term: 149 index: 130 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:32.514963 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 150 candidate_status { last_received { term: 149 index: 130 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:32.515033 10246 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 149 FOLLOWER]: Advancing to term 150
I20260204 09:11:32.515600 10246 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 150 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 150.
I20260204 09:11:32.515796 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 150 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:32.515893 10584 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 150 FOLLOWER]: Leader election won for term 150
I20260204 09:11:32.515969 10584 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 150 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:32.516024 10584 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 130, Committed index: 130, Last appended: 149.130, Last appended by leader: 130, Current term: 150, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:32.516492 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 149 to 150, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 150 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:32.522367 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 150 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 149. Current term is 150. Ops: []
I20260204 09:11:32.522610 10600 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 149.130, Next index: 131, Last known committed idx: 130, Time since last communication: 0.000s
I20260204 09:11:32.522729 10606 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 149 LEADER]: Stepping down as leader of term 149
I20260204 09:11:32.522779 10606 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 149 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:32.522859 10606 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 130, Committed index: 130, Last appended: 149.130, Last appended by leader: 130, Current term: 149, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:32.522948 10606 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 149 FOLLOWER]: Advancing to term 150
I20260204 09:11:32.615864 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 150 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 149 index: 130. Preceding OpId from leader: term: 150 index: 131. (index mismatch)
I20260204 09:11:32.616142 10584 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 131, Last known committed idx: 130, Time since last communication: 0.000s
I20260204 09:11:32.617162 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 150 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 149 index: 130. Preceding OpId from leader: term: 150 index: 131. (index mismatch)
I20260204 09:11:32.617326 10604 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 131, Last known committed idx: 130, Time since last communication: 0.000s
I20260204 09:11:32.800601 10606 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 150 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:32.800695 10606 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 150 FOLLOWER]: Advancing to term 151
I20260204 09:11:32.801393 10606 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 151 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:32.801615 10606 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 151 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:32.801870 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 151 candidate_status { last_received { term: 150 index: 131 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:32.801885 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 151 candidate_status { last_received { term: 150 index: 131 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:32.802139 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 151 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:32.802230 10606 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 151 FOLLOWER]: Leader election lost for term 151. Reason: could not achieve majority
I20260204 09:11:32.819456 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 151 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 150. Current term is 151. Ops: []
I20260204 09:11:32.819743 10604 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 150.131, Next index: 132, Last known committed idx: 131, Time since last communication: 0.000s
I20260204 09:11:32.819865 10603 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 150 LEADER]: Stepping down as leader of term 150
I20260204 09:11:32.819907 10603 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 150 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:32.819967 10603 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 131, Committed index: 131, Last appended: 150.131, Last appended by leader: 131, Current term: 150, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:32.820058 10603 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 150 FOLLOWER]: Advancing to term 151
I20260204 09:11:32.886952 10597 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 150 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:32.887081 10597 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 150 FOLLOWER]: Advancing to term 151
I20260204 09:11:32.887887 10597 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 151 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:32.888098 10597 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 151 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:32.888307 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 151 candidate_status { last_received { term: 150 index: 131 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:32.888314 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 151 candidate_status { last_received { term: 150 index: 131 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:32.888424 10397 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 151 FOLLOWER]: Leader election vote request: Denying vote to candidate 11502cf05241427fb9853e628add7746 in current term 151: Already voted for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in this term.
I20260204 09:11:32.888965 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 151 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 151.
I20260204 09:11:32.889132 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 151 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:32.889221 10597 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 151 FOLLOWER]: Leader election won for term 151
I20260204 09:11:32.889348 10597 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 151 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:32.889441 10597 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 131, Committed index: 131, Last appended: 150.131, Last appended by leader: 131, Current term: 151, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:32.890007 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 150 to 151, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 151 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:32.920003 10606 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 151 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:32.920086 10606 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 151 FOLLOWER]: Advancing to term 152
I20260204 09:11:32.920730 10606 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 152 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:32.920895 10606 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 152 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:32.921082 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 152 candidate_status { last_received { term: 150 index: 131 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:32.921077 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 152 candidate_status { last_received { term: 150 index: 131 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:32.921175 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 151 FOLLOWER]: Advancing to term 152
I20260204 09:11:32.921785 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 152 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 152.
I20260204 09:11:32.921937 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 152 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:32.922017 10606 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 152 FOLLOWER]: Leader election won for term 152
I20260204 09:11:32.922067 10606 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 152 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:32.922119 10606 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 131, Committed index: 131, Last appended: 150.131, Last appended by leader: 131, Current term: 152, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:32.922528 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 151 to 152, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 152 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:32.965176 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 152 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 151. Current term is 152. Ops: []
I20260204 09:11:32.965493 10597 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 0.0, Next index: 132, Last known committed idx: 131, Time since last communication: 0.000s
I20260204 09:11:32.965602 10597 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 151 LEADER]: Stepping down as leader of term 151
I20260204 09:11:32.965628 10597 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 151 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:32.965690 10597 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 131, Committed index: 131, Last appended: 151.132, Last appended by leader: 132, Current term: 151, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:32.965760 10597 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 151 FOLLOWER]: Advancing to term 152
I20260204 09:11:32.988137 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:33.014945 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 152 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 151 index: 132. Preceding OpId from leader: term: 152 index: 132. (term mismatch)
I20260204 09:11:33.015021 10246 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting all ops after (but not including) 131
I20260204 09:11:33.015034 10246 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting uncommitted NO_OP operation due to leader change: 151.132
I20260204 09:11:33.015048 10246 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 152 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:33.015218 10606 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 132, Last known committed idx: 131, Time since last communication: 0.000s
I20260204 09:11:33.016182 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 152 FOLLOWER]: Refusing update from remote peer 8b12f9075d9d4ffa9fd711322da0c4d2: Log matching property violated. Preceding OpId in replica: term: 150 index: 131. Preceding OpId from leader: term: 152 index: 132. (index mismatch)
I20260204 09:11:33.016363 10608 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 132, Last known committed idx: 131, Time since last communication: 0.000s
I20260204 09:11:33.117621 10603 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 152 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:33.117712 10603 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 152 FOLLOWER]: Advancing to term 153
I20260204 09:11:33.118371 10603 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 153 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:33.118548 10603 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 153 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:33.118739 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 153 candidate_status { last_received { term: 152 index: 132 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:33.118747 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 153 candidate_status { last_received { term: 152 index: 132 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:33.118970 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 153 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:33.119046 10603 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 153 FOLLOWER]: Leader election lost for term 153. Reason: could not achieve majority
I20260204 09:11:33.135330 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 153 FOLLOWER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 152. Current term is 153. Ops: []
I20260204 09:11:33.135551 10606 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 152.132, Next index: 133, Last known committed idx: 132, Time since last communication: 0.000s
I20260204 09:11:33.135661 10606 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 152 LEADER]: Stepping down as leader of term 152
I20260204 09:11:33.135689 10606 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 152 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:33.135743 10606 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 132, Committed index: 132, Last appended: 152.132, Last appended by leader: 132, Current term: 152, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:33.135818 10606 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 152 FOLLOWER]: Advancing to term 153
I20260204 09:11:33.196301 10597 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 152 FOLLOWER]: Starting leader election (detected failure of leader 8b12f9075d9d4ffa9fd711322da0c4d2)
I20260204 09:11:33.196401 10597 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 152 FOLLOWER]: Advancing to term 153
I20260204 09:11:33.197064 10597 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 153 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:33.197227 10597 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 153 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:33.197428 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 153 candidate_status { last_received { term: 152 index: 132 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:33.197435 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 153 candidate_status { last_received { term: 152 index: 132 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:33.197531 10322 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 153 FOLLOWER]: Leader election vote request: Denying vote to candidate 11502cf05241427fb9853e628add7746 in current term 153: Already voted for candidate bd38b0e96f264071a69be73b6b4f14c1 in this term.
I20260204 09:11:33.198017 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 153 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 153.
I20260204 09:11:33.198184 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 153 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:33.198258 10597 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 153 FOLLOWER]: Leader election won for term 153
I20260204 09:11:33.198309 10597 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 153 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:33.198349 10597 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 132, Committed index: 132, Last appended: 152.132, Last appended by leader: 132, Current term: 153, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:33.198768 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 152 to 153, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 153 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:33.257833 10603 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 153 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:33.257925 10603 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 153 FOLLOWER]: Advancing to term 154
I20260204 09:11:33.258589 10603 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 154 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:33.258744 10603 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 154 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:33.258955 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 154 candidate_status { last_received { term: 152 index: 132 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:33.258963 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 154 candidate_status { last_received { term: 152 index: 132 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:33.259052 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 153 FOLLOWER]: Advancing to term 154
I20260204 09:11:33.259588 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 154 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 154.
I20260204 09:11:33.259743 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 154 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:33.259822 10603 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 154 FOLLOWER]: Leader election won for term 154
I20260204 09:11:33.259879 10603 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 154 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:33.259931 10603 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 132, Committed index: 132, Last appended: 152.132, Last appended by leader: 132, Current term: 154, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:33.260334 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 153 to 154, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 154 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:33.290031 10322 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 154 LEADER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 153. Current term is 154. Ops: []
I20260204 09:11:33.290280 10597 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: INVALID_TERM, Last received: 0.0, Next index: 133, Last known committed idx: 132, Time since last communication: 0.000s
I20260204 09:11:33.290391 10597 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer bd38b0e96f264071a69be73b6b4f14c1 log is divergent from this leader: its last log entry 154.133 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 132
I20260204 09:11:33.290433 10607 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 153 LEADER]: Stepping down as leader of term 153
I20260204 09:11:33.290472 10607 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 153 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:33.290534 10607 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 132, Committed index: 132, Last appended: 153.133, Last appended by leader: 133, Current term: 153, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:33.290611 10607 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 153 FOLLOWER]: Advancing to term 154
I20260204 09:11:33.366798 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 154 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 152 index: 132. Preceding OpId from leader: term: 154 index: 133. (index mismatch)
I20260204 09:11:33.367050 10603 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 133, Last known committed idx: 132, Time since last communication: 0.000s
I20260204 09:11:33.368018 10246 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 154 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 153 index: 133. Preceding OpId from leader: term: 154 index: 133. (term mismatch)
I20260204 09:11:33.368074 10246 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting all ops after (but not including) 132
I20260204 09:11:33.368093 10246 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: Aborting uncommitted NO_OP operation due to leader change: 153.133
I20260204 09:11:33.368110 10246 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 154 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:33.368273 10609 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 133, Last known committed idx: 132, Time since last communication: 0.000s
I20260204 09:11:33.557561 10607 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 154 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:33.557658 10607 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 154 FOLLOWER]: Advancing to term 155
I20260204 09:11:33.558344 10607 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 155 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:33.558513 10607 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 155 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:33.558722 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 155 candidate_status { last_received { term: 154 index: 133 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:33.558722 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 155 candidate_status { last_received { term: 154 index: 133 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:33.559003 10211 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 155 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11502cf05241427fb9853e628add7746; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:33.559096 10607 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 155 FOLLOWER]: Leader election lost for term 155. Reason: could not achieve majority
I20260204 09:11:33.575965 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 155 FOLLOWER]: Rejecting Update request from peer bd38b0e96f264071a69be73b6b4f14c1 for earlier term 154. Current term is 155. Ops: []
I20260204 09:11:33.576213 10604 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 154.133, Next index: 134, Last known committed idx: 133, Time since last communication: 0.000s
I20260204 09:11:33.576334 10604 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 154 LEADER]: Stepping down as leader of term 154
I20260204 09:11:33.576368 10604 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 154 LEADER]: Becoming Follower/Learner. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:33.576431 10604 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 133, Committed index: 133, Last appended: 154.133, Last appended by leader: 133, Current term: 154, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:33.576519 10604 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 154 FOLLOWER]: Advancing to term 155
I20260204 09:11:33.631989 10606 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 154 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:33.632074 10606 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 154 FOLLOWER]: Advancing to term 155
I20260204 09:11:33.632702 10606 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 155 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:33.632875 10606 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 155 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:33.633065 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 155 candidate_status { last_received { term: 154 index: 133 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:33.633080 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 155 candidate_status { last_received { term: 154 index: 133 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:33.633163 10246 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 155 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in current term 155: Already voted for candidate 11502cf05241427fb9853e628add7746 in this term.
I20260204 09:11:33.633688 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 155 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in term 155.
I20260204 09:11:33.633852 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 155 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:33.633927 10606 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 155 FOLLOWER]: Leader election won for term 155
I20260204 09:11:33.633973 10606 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 155 LEADER]: Becoming Leader. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:33.634008 10606 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 133, Committed index: 133, Last appended: 154.133, Last appended by leader: 133, Current term: 155, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:33.634416 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 reported cstate change: term changed from 154 to 155, leader changed from bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2) to 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3). New cstate: current_term: 155 leader_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:33.674573 10607 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 155 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:33.674681 10607 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 155 FOLLOWER]: Advancing to term 156
I20260204 09:11:33.675302 10607 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 156 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:33.675452 10607 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 156 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:33.675647 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 156 candidate_status { last_received { term: 154 index: 133 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:33.675662 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "11502cf05241427fb9853e628add7746" candidate_term: 156 candidate_status { last_received { term: 154 index: 133 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:33.675735 10322 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 155 FOLLOWER]: Advancing to term 156
I20260204 09:11:33.676244 10322 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 156 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11502cf05241427fb9853e628add7746 in term 156.
I20260204 09:11:33.676400 10212 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [CANDIDATE]: Term 156 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1; no voters: 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:33.676508 10607 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 156 FOLLOWER]: Leader election won for term 156
I20260204 09:11:33.676551 10607 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 156 LEADER]: Becoming Leader. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:33.676590 10607 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 133, Committed index: 133, Last appended: 154.133, Last appended by leader: 133, Current term: 156, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:33.677032 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 reported cstate change: term changed from 155 to 156, leader changed from 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3) to 11502cf05241427fb9853e628add7746 (127.9.224.1). New cstate: current_term: 156 leader_uuid: "11502cf05241427fb9853e628add7746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:33.731761 10246 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 156 LEADER]: Rejecting Update request from peer 8b12f9075d9d4ffa9fd711322da0c4d2 for earlier term 155. Current term is 156. Ops: []
I20260204 09:11:33.732024 10606 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 134, Last known committed idx: 133, Time since last communication: 0.000s
I20260204 09:11:33.732148 10606 consensus_queue.cc:1243] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [LEADER]: Peer 11502cf05241427fb9853e628add7746 log is divergent from this leader: its last log entry 156.134 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 133
I20260204 09:11:33.732191 10600 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 155 LEADER]: Stepping down as leader of term 155
I20260204 09:11:33.732232 10600 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 155 LEADER]: Becoming Follower/Learner. State: Replica: 8b12f9075d9d4ffa9fd711322da0c4d2, State: Running, Role: LEADER
I20260204 09:11:33.732288 10600 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 133, Committed index: 133, Last appended: 155.134, Last appended by leader: 134, Current term: 155, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:33.732378 10600 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 155 FOLLOWER]: Advancing to term 156
I20260204 09:11:33.759408 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 156 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 155 index: 134. Preceding OpId from leader: term: 156 index: 134. (term mismatch)
I20260204 09:11:33.759495 10397 pending_rounds.cc:85] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2: Aborting all ops after (but not including) 133
I20260204 09:11:33.759516 10397 pending_rounds.cc:107] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2: Aborting uncommitted NO_OP operation due to leader change: 155.134
I20260204 09:11:33.759533 10397 raft_consensus.cc:2889] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 156 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:33.759749 10607 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 134, Last known committed idx: 133, Time since last communication: 0.000s
I20260204 09:11:33.760919 10322 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 156 FOLLOWER]: Refusing update from remote peer 11502cf05241427fb9853e628add7746: Log matching property violated. Preceding OpId in replica: term: 154 index: 133. Preceding OpId from leader: term: 156 index: 134. (index mismatch)
I20260204 09:11:33.761112 10597 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 134, Last known committed idx: 133, Time since last communication: 0.000s
I20260204 09:11:33.957234 10604 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 156 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:33.957337 10604 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 156 FOLLOWER]: Advancing to term 157
I20260204 09:11:33.958026 10604 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 157 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:33.958160 10604 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 157 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:33.958379 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 157 candidate_status { last_received { term: 156 index: 134 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:33.958400 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 157 candidate_status { last_received { term: 156 index: 134 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:33.958640 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 157 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746, 8b12f9075d9d4ffa9fd711322da0c4d2
I20260204 09:11:33.958755 10604 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 157 FOLLOWER]: Leader election lost for term 157. Reason: could not achieve majority
I20260204 09:11:33.961710 10600 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 156 FOLLOWER]: Starting leader election (detected failure of leader 11502cf05241427fb9853e628add7746)
I20260204 09:11:33.961764 10600 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 156 FOLLOWER]: Advancing to term 157
I20260204 09:11:33.962324 10600 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 157 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:33.962455 10600 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 157 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
I20260204 09:11:33.962630 10246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 157 candidate_status { last_received { term: 156 index: 134 } } ignore_live_leader: false dest_uuid: "11502cf05241427fb9853e628add7746"
I20260204 09:11:33.962636 10397 raft_consensus.cc:1240] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 157 FOLLOWER]: Rejecting Update request from peer 11502cf05241427fb9853e628add7746 for earlier term 156. Current term is 157. Ops: []
I20260204 09:11:33.962635 10322 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" candidate_term: 157 candidate_status { last_received { term: 156 index: 134 } } ignore_live_leader: false dest_uuid: "bd38b0e96f264071a69be73b6b4f14c1"
I20260204 09:11:33.962778 10322 raft_consensus.cc:2393] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 157 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b12f9075d9d4ffa9fd711322da0c4d2 in current term 157: Already voted for candidate bd38b0e96f264071a69be73b6b4f14c1 in this term.
I20260204 09:11:33.962857 10597 consensus_queue.cc:1059] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: INVALID_TERM, Last received: 156.134, Next index: 135, Last known committed idx: 134, Time since last communication: 0.000s
I20260204 09:11:33.962936 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 157 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:33.962949 10610 raft_consensus.cc:3055] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 156 LEADER]: Stepping down as leader of term 156
I20260204 09:11:33.963009 10610 raft_consensus.cc:740] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 156 LEADER]: Becoming Follower/Learner. State: Replica: 11502cf05241427fb9853e628add7746, State: Running, Role: LEADER
I20260204 09:11:33.963038 10600 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 157 FOLLOWER]: Leader election lost for term 157. Reason: could not achieve majority
I20260204 09:11:33.963076 10610 consensus_queue.cc:260] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 134, Committed index: 134, Last appended: 156.134, Last appended by leader: 134, Current term: 156, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:33.963151 10610 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 156 FOLLOWER]: Advancing to term 157
I20260204 09:11:33.988358 10112 timestamp_advancement-itest.cc:267] GCing logs...
/home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/integration-tests/timestamp_advancement-itest.cc:267: Failure
Expected: (gcable_size) > (0), actual: 0 vs 0
/home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/util/test_util.cc:403: Failure
Failed
Timed out waiting for assertion to pass.
/home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/integration-tests/timestamp_advancement-itest.cc:332: Failure
Expected: GCUntilNoWritesInWAL(ts, replica) doesn't generate new fatal failures in the current thread.
Actual: it does.
I20260204 09:11:33.988619 10112 tablet_server.cc:178] TabletServer@127.9.224.1:0 shutting down...
I20260204 09:11:34.062155 10604 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 157 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:34.062261 10604 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 157 FOLLOWER]: Advancing to term 158
I20260204 09:11:34.062988 10604 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 158 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:34.063161 10604 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 158 election: Requested vote from peers 8b12f9075d9d4ffa9fd711322da0c4d2 (127.9.224.3:33317), 11502cf05241427fb9853e628add7746 (127.9.224.1:45383)
I20260204 09:11:34.063381 10397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75502959dace4d33aa1d322299eefe57" candidate_uuid: "bd38b0e96f264071a69be73b6b4f14c1" candidate_term: 158 candidate_status { last_received { term: 156 index: 134 } } ignore_live_leader: false dest_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2"
I20260204 09:11:34.063475 10397 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 157 FOLLOWER]: Advancing to term 158
W20260204 09:11:34.063483 10287 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260204 09:11:34.063925 10287 leader_election.cc:336] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 158 election: RPC error from VoteRequest() call to peer 11502cf05241427fb9853e628add7746 (127.9.224.1:45383): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260204 09:11:34.064173 10397 raft_consensus.cc:2468] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 158 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd38b0e96f264071a69be73b6b4f14c1 in term 158.
I20260204 09:11:34.064313 10287 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [CANDIDATE]: Term 158 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2, bd38b0e96f264071a69be73b6b4f14c1; no voters: 11502cf05241427fb9853e628add7746
I20260204 09:11:34.064379 10604 raft_consensus.cc:2804] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 158 FOLLOWER]: Leader election won for term 158
I20260204 09:11:34.064445 10604 raft_consensus.cc:697] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 158 LEADER]: Becoming Leader. State: Replica: bd38b0e96f264071a69be73b6b4f14c1, State: Running, Role: LEADER
I20260204 09:11:34.064503 10604 consensus_queue.cc:237] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 134, Committed index: 134, Last appended: 156.134, Last appended by leader: 134, Current term: 158, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:34.064960 10141 catalog_manager.cc:5654] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 reported cstate change: term changed from 156 to 158, leader changed from 11502cf05241427fb9853e628add7746 (127.9.224.1) to bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2). New cstate: current_term: 158 leader_uuid: "bd38b0e96f264071a69be73b6b4f14c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } health_report { overall_health: HEALTHY } } }
W20260204 09:11:34.156512 10287 consensus_peers.cc:597] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 -> Peer 11502cf05241427fb9853e628add7746 (127.9.224.1:45383): Couldn't send request to peer 11502cf05241427fb9853e628add7746. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260204 09:11:34.171043 10397 raft_consensus.cc:1275] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 158 FOLLOWER]: Refusing update from remote peer bd38b0e96f264071a69be73b6b4f14c1: Log matching property violated. Preceding OpId in replica: term: 156 index: 134. Preceding OpId from leader: term: 158 index: 135. (index mismatch)
I20260204 09:11:34.171269 10604 consensus_queue.cc:1048] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 135, Last known committed idx: 134, Time since last communication: 0.000s
I20260204 09:11:34.219486 10112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260204 09:11:34.219641 10112 tablet_replica.cc:333] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746: stopping tablet replica
I20260204 09:11:34.219718 10112 raft_consensus.cc:2243] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 157 FOLLOWER]: Raft consensus shutting down.
I20260204 09:11:34.219782 10112 raft_consensus.cc:2272] T 75502959dace4d33aa1d322299eefe57 P 11502cf05241427fb9853e628add7746 [term 157 FOLLOWER]: Raft consensus is shut down!
I20260204 09:11:34.232214 10112 tablet_server.cc:195] TabletServer@127.9.224.1:0 shutdown complete.
I20260204 09:11:34.233640 10112 tablet_server.cc:178] TabletServer@127.9.224.2:0 shutting down...
I20260204 09:11:34.240046 10112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260204 09:11:34.240206 10112 tablet_replica.cc:333] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1: stopping tablet replica
I20260204 09:11:34.240267 10112 raft_consensus.cc:2243] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 158 LEADER]: Raft consensus shutting down.
I20260204 09:11:34.240343 10112 raft_consensus.cc:2272] T 75502959dace4d33aa1d322299eefe57 P bd38b0e96f264071a69be73b6b4f14c1 [term 158 FOLLOWER]: Raft consensus is shut down!
I20260204 09:11:34.242280 10112 tablet_server.cc:195] TabletServer@127.9.224.2:0 shutdown complete.
I20260204 09:11:34.243009 10112 tablet_server.cc:178] TabletServer@127.9.224.3:0 shutting down...
I20260204 09:11:34.272472 10600 raft_consensus.cc:493] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 158 FOLLOWER]: Starting leader election (detected failure of leader bd38b0e96f264071a69be73b6b4f14c1)
I20260204 09:11:34.272570 10600 raft_consensus.cc:3060] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 158 FOLLOWER]: Advancing to term 159
I20260204 09:11:34.273182 10600 raft_consensus.cc:515] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 159 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b12f9075d9d4ffa9fd711322da0c4d2" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 33317 } } peers { permanent_uuid: "11502cf05241427fb9853e628add7746" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 45383 } } peers { permanent_uuid: "bd38b0e96f264071a69be73b6b4f14c1" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43259 } }
I20260204 09:11:34.273335 10600 leader_election.cc:290] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 159 election: Requested vote from peers 11502cf05241427fb9853e628add7746 (127.9.224.1:45383), bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259)
W20260204 09:11:34.273957 10362 leader_election.cc:336] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 159 election: RPC error from VoteRequest() call to peer 11502cf05241427fb9853e628add7746 (127.9.224.1:45383): Network error: Client connection negotiation failed: client connection to 127.9.224.1:45383: connect: Connection refused (error 111)
W20260204 09:11:34.274022 10363 leader_election.cc:336] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 159 election: RPC error from VoteRequest() call to peer bd38b0e96f264071a69be73b6b4f14c1 (127.9.224.2:43259): Network error: Client connection negotiation failed: client connection to 127.9.224.2:43259: connect: Connection refused (error 111)
I20260204 09:11:34.274092 10363 leader_election.cc:304] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [CANDIDATE]: Term 159 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b12f9075d9d4ffa9fd711322da0c4d2; no voters: 11502cf05241427fb9853e628add7746, bd38b0e96f264071a69be73b6b4f14c1
I20260204 09:11:34.274169 10600 raft_consensus.cc:2749] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 159 FOLLOWER]: Leader election lost for term 159. Reason: could not achieve majority
I20260204 09:11:34.277575 10112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260204 09:11:34.277686 10112 tablet_replica.cc:333] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2: stopping tablet replica
I20260204 09:11:34.277731 10112 raft_consensus.cc:2243] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 159 FOLLOWER]: Raft consensus shutting down.
I20260204 09:11:34.277784 10112 raft_consensus.cc:2272] T 75502959dace4d33aa1d322299eefe57 P 8b12f9075d9d4ffa9fd711322da0c4d2 [term 159 FOLLOWER]: Raft consensus is shut down!
I20260204 09:11:34.289569 10112 tablet_server.cc:195] TabletServer@127.9.224.3:0 shutdown complete.
I20260204 09:11:34.290416 10112 master.cc:561] Master@127.9.224.62:37085 shutting down...
I20260204 09:11:34.407502 10112 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3adb304102e74e299fa193e13058a041 [term 1 LEADER]: Raft consensus shutting down.
I20260204 09:11:34.407610 10112 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3adb304102e74e299fa193e13058a041 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 09:11:34.407634 10112 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3adb304102e74e299fa193e13058a041: stopping tablet replica
I20260204 09:11:34.420096 10112 master.cc:583] Master@127.9.224.62:37085 shutdown complete.
I20260204 09:11:34.421903 10112 test_util.cc:183] -----------------------------------------------
I20260204 09:11:34.421949 10112 test_util.cc:184] Had failures, leaving test files at /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1770196261863819-10112-0
[ FAILED ] TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData (32553 ms)
[ RUN ] TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap
I20260204 09:11:34.422343 10112 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.224.62:42277
I20260204 09:11:34.422462 10112 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 09:11:34.423420 10620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 09:11:34.423574 10617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 09:11:34.423631 10112 server_base.cc:1060] running on GCE node
W20260204 09:11:34.423563 10618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 09:11:34.423841 10112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 09:11:34.423871 10112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 09:11:34.423882 10112 hybrid_clock.cc:648] HybridClock initialized: now 1770196294423882 us; error 0 us; skew 500 ppm
I20260204 09:11:34.424381 10112 webserver.cc:492] Webserver started at http://127.9.224.62:33317/ using document root <none> and password file <none>
I20260204 09:11:34.424443 10112 fs_manager.cc:362] Metadata directory not provided
I20260204 09:11:34.424479 10112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 09:11:34.424512 10112 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 09:11:34.424717 10112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1770196261863819-10112-0/minicluster-data/master-0-root/instance:
uuid: "541e2e06aa704740adb7e9d1c5272df8"
format_stamp: "Formatted at 2026-02-04 09:11:34 on dist-test-slave-4hq3"
I20260204 09:11:34.425503 10112 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260204 09:11:34.425904 10625 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:34.426016 10112 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:34.426057 10112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1770196261863819-10112-0/minicluster-data/master-0-root
uuid: "541e2e06aa704740adb7e9d1c5272df8"
format_stamp: "Formatted at 2026-02-04 09:11:34 on dist-test-slave-4hq3"
I20260204 09:11:34.426097 10112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1770196261863819-10112-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1770196261863819-10112-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1770196261863819-10112-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 09:11:34.458184 10112 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 09:11:34.458364 10112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 09:11:34.460713 10112 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.62:42277
I20260204 09:11:34.462349 10677 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.224.62:42277 every 8 connection(s)
I20260204 09:11:34.462510 10678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 09:11:34.463493 10678 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 541e2e06aa704740adb7e9d1c5272df8: Bootstrap starting.
I20260204 09:11:34.463766 10678 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 541e2e06aa704740adb7e9d1c5272df8: Neither blocks nor log segments found. Creating new log.
I20260204 09:11:34.464177 10678 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 541e2e06aa704740adb7e9d1c5272df8: No bootstrap required, opened a new log
I20260204 09:11:34.464289 10678 raft_consensus.cc:359] T 00000000000000000000000000000000 P 541e2e06aa704740adb7e9d1c5272df8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "541e2e06aa704740adb7e9d1c5272df8" member_type: VOTER }
I20260204 09:11:34.464339 10678 raft_consensus.cc:385] T 00000000000000000000000000000000 P 541e2e06aa704740adb7e9d1c5272df8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 09:11:34.464355 10678 raft_consensus.cc:740] T 00000000000000000000000000000000 P 541e2e06aa704740adb7e9d1c5272df8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 541e2e06aa704740adb7e9d1c5272df8, State: Initialized, Role: FOLLOWER
I20260204 09:11:34.464407 10678 consensus_queue.cc:260] T 00000000000000000000000000000000 P 541e2e06aa704740adb7e9d1c5272df8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "541e2e06aa704740adb7e9d1c5272df8" member_type: VOTER }
I20260204 09:11:34.464437 10678 raft_consensus.cc:399] T 00000000000000000000000000000000 P 541e2e06aa704740adb7e9d1c5272df8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260204 09:11:34.464455 10678 raft_consensus.cc:493] T 00000000000000000000000000000000 P 541e2e06aa704740adb7e9d1c5272df8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260204 09:11:34.464479 10678 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 541e2e06aa704740adb7e9d1c5272df8 [term 0 FOLLOWER]: Advancing to term 1
I20260204 09:11:34.464941 10678 raft_consensus.cc:515] T 00000000000000000000000000000000 P 541e2e06aa704740adb7e9d1c5272df8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "541e2e06aa704740adb7e9d1c5272df8" member_type: VOTER }
I20260204 09:11:34.464993 10678 leader_election.cc:304] T 00000000000000000000000000000000 P 541e2e06aa704740adb7e9d1c5272df8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 541e2e06aa704740adb7e9d1c5272df8; no voters:
I20260204 09:11:34.465080 10678 leader_election.cc:290] T 00000000000000000000000000000000 P 541e2e06aa704740adb7e9d1c5272df8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260204 09:11:34.465132 10681 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 541e2e06aa704740adb7e9d1c5272df8 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 09:11:34.465221 10678 sys_catalog.cc:565] T 00000000000000000000000000000000 P 541e2e06aa704740adb7e9d1c5272df8 [sys.catalog]: configured and running, proceeding with master startup.
I20260204 09:11:34.465237 10681 raft_consensus.cc:697] T 00000000000000000000000000000000 P 541e2e06aa704740adb7e9d1c5272df8 [term 1 LEADER]: Becoming Leader. State: Replica: 541e2e06aa704740adb7e9d1c5272df8, State: Running, Role: LEADER
I20260204 09:11:34.465276 10681 consensus_queue.cc:237] T 00000000000000000000000000000000 P 541e2e06aa704740adb7e9d1c5272df8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "541e2e06aa704740adb7e9d1c5272df8" member_type: VOTER }
I20260204 09:11:34.465479 10682 sys_catalog.cc:455] T 00000000000000000000000000000000 P 541e2e06aa704740adb7e9d1c5272df8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "541e2e06aa704740adb7e9d1c5272df8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "541e2e06aa704740adb7e9d1c5272df8" member_type: VOTER } }
I20260204 09:11:34.465487 10683 sys_catalog.cc:455] T 00000000000000000000000000000000 P 541e2e06aa704740adb7e9d1c5272df8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 541e2e06aa704740adb7e9d1c5272df8. Latest consensus state: current_term: 1 leader_uuid: "541e2e06aa704740adb7e9d1c5272df8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "541e2e06aa704740adb7e9d1c5272df8" member_type: VOTER } }
I20260204 09:11:34.465559 10682 sys_catalog.cc:458] T 00000000000000000000000000000000 P 541e2e06aa704740adb7e9d1c5272df8 [sys.catalog]: This master's current role is: LEADER
I20260204 09:11:34.465566 10683 sys_catalog.cc:458] T 00000000000000000000000000000000 P 541e2e06aa704740adb7e9d1c5272df8 [sys.catalog]: This master's current role is: LEADER
I20260204 09:11:34.465703 10685 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260204 09:11:34.465889 10685 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260204 09:11:34.466446 10112 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260204 09:11:34.466980 10685 catalog_manager.cc:1357] Generated new cluster ID: a0d52d557a794eb9950c8212682ce7d9
I20260204 09:11:34.467028 10685 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260204 09:11:34.484761 10685 catalog_manager.cc:1380] Generated new certificate authority record
I20260204 09:11:34.485185 10685 catalog_manager.cc:1514] Loading token signing keys...
I20260204 09:11:34.494339 10685 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 541e2e06aa704740adb7e9d1c5272df8: Generated new TSK 0
I20260204 09:11:34.494415 10685 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260204 09:11:34.498183 10112 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 09:11:34.499264 10699 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 09:11:34.499372 10112 server_base.cc:1060] running on GCE node
W20260204 09:11:34.499310 10702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 09:11:34.499339 10700 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 09:11:34.499645 10112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 09:11:34.499676 10112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 09:11:34.499687 10112 hybrid_clock.cc:648] HybridClock initialized: now 1770196294499688 us; error 0 us; skew 500 ppm
I20260204 09:11:34.500174 10112 webserver.cc:492] Webserver started at http://127.9.224.1:44497/ using document root <none> and password file <none>
I20260204 09:11:34.500247 10112 fs_manager.cc:362] Metadata directory not provided
I20260204 09:11:34.500285 10112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 09:11:34.500329 10112 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 09:11:34.500559 10112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1770196261863819-10112-0/minicluster-data/ts-0-root/instance:
uuid: "221661cb244d40738b986866c02b37fc"
format_stamp: "Formatted at 2026-02-04 09:11:34 on dist-test-slave-4hq3"
I20260204 09:11:34.501375 10112 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260204 09:11:34.501863 10707 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:34.501989 10112 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:34.502027 10112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1770196261863819-10112-0/minicluster-data/ts-0-root
uuid: "221661cb244d40738b986866c02b37fc"
format_stamp: "Formatted at 2026-02-04 09:11:34 on dist-test-slave-4hq3"
I20260204 09:11:34.502070 10112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1770196261863819-10112-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1770196261863819-10112-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1770196261863819-10112-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 09:11:34.519784 10112 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 09:11:34.519987 10112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 09:11:34.520113 10112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260204 09:11:34.520303 10112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260204 09:11:34.520327 10112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:34.520354 10112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260204 09:11:34.520377 10112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:34.522986 10112 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.1:42423
I20260204 09:11:34.523027 10770 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.224.1:42423 every 8 connection(s)
I20260204 09:11:34.523313 10112 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 09:11:34.524402 10778 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 09:11:34.524533 10776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 09:11:34.524437 10775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 09:11:34.524813 10112 server_base.cc:1060] running on GCE node
I20260204 09:11:34.524933 10112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 09:11:34.524969 10112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 09:11:34.525000 10112 hybrid_clock.cc:648] HybridClock initialized: now 1770196294525000 us; error 0 us; skew 500 ppm
I20260204 09:11:34.525619 10112 webserver.cc:492] Webserver started at http://127.9.224.2:39671/ using document root <none> and password file <none>
I20260204 09:11:34.525718 10112 fs_manager.cc:362] Metadata directory not provided
I20260204 09:11:34.525767 10112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 09:11:34.525820 10112 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 09:11:34.526124 10112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1770196261863819-10112-0/minicluster-data/ts-1-root/instance:
uuid: "569cc1b853df4850b68d0e630e2ccafa"
format_stamp: "Formatted at 2026-02-04 09:11:34 on dist-test-slave-4hq3"
I20260204 09:11:34.526777 10771 heartbeater.cc:344] Connected to a master server at 127.9.224.62:42277
I20260204 09:11:34.526844 10771 heartbeater.cc:461] Registering TS with master...
I20260204 09:11:34.526963 10771 heartbeater.cc:507] Master 127.9.224.62:42277 requested a full tablet report, sending...
I20260204 09:11:34.527170 10642 ts_manager.cc:194] Registered new tserver with Master: 221661cb244d40738b986866c02b37fc (127.9.224.1:42423)
I20260204 09:11:34.527307 10112 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260204 09:11:34.527799 10783 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:34.527926 10642 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37504
I20260204 09:11:34.527910 10112 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:34.528002 10112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1770196261863819-10112-0/minicluster-data/ts-1-root
uuid: "569cc1b853df4850b68d0e630e2ccafa"
format_stamp: "Formatted at 2026-02-04 09:11:34 on dist-test-slave-4hq3"
I20260204 09:11:34.528054 10112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1770196261863819-10112-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1770196261863819-10112-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1770196261863819-10112-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 09:11:34.562551 10112 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 09:11:34.562815 10112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 09:11:34.562991 10112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260204 09:11:34.563198 10112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260204 09:11:34.563230 10112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:34.563263 10112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260204 09:11:34.563292 10112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:34.566751 10112 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.2:43003
I20260204 09:11:34.566797 10846 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.224.2:43003 every 8 connection(s)
I20260204 09:11:34.567127 10112 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 09:11:34.568240 10850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 09:11:34.568425 10853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 09:11:34.568639 10851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 09:11:34.568637 10112 server_base.cc:1060] running on GCE node
I20260204 09:11:34.568895 10112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 09:11:34.568929 10112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 09:11:34.568940 10112 hybrid_clock.cc:648] HybridClock initialized: now 1770196294568941 us; error 0 us; skew 500 ppm
I20260204 09:11:34.569551 10112 webserver.cc:492] Webserver started at http://127.9.224.3:34753/ using document root <none> and password file <none>
I20260204 09:11:34.569645 10112 fs_manager.cc:362] Metadata directory not provided
I20260204 09:11:34.569695 10112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 09:11:34.569751 10112 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 09:11:34.570070 10112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1770196261863819-10112-0/minicluster-data/ts-2-root/instance:
uuid: "410861e0f65b4777a1e91bc3129fe211"
format_stamp: "Formatted at 2026-02-04 09:11:34 on dist-test-slave-4hq3"
I20260204 09:11:34.570183 10847 heartbeater.cc:344] Connected to a master server at 127.9.224.62:42277
I20260204 09:11:34.570241 10847 heartbeater.cc:461] Registering TS with master...
I20260204 09:11:34.570339 10847 heartbeater.cc:507] Master 127.9.224.62:42277 requested a full tablet report, sending...
I20260204 09:11:34.570536 10642 ts_manager.cc:194] Registered new tserver with Master: 569cc1b853df4850b68d0e630e2ccafa (127.9.224.2:43003)
I20260204 09:11:34.570879 10642 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37518
I20260204 09:11:34.571089 10112 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260204 09:11:34.571583 10858 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:34.571698 10112 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:34.571748 10112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1770196261863819-10112-0/minicluster-data/ts-2-root
uuid: "410861e0f65b4777a1e91bc3129fe211"
format_stamp: "Formatted at 2026-02-04 09:11:34 on dist-test-slave-4hq3"
I20260204 09:11:34.571794 10112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1770196261863819-10112-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1770196261863819-10112-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1770196261863819-10112-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 09:11:34.576296 10112 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 09:11:34.576510 10112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 09:11:34.576653 10112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260204 09:11:34.576835 10112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260204 09:11:34.576865 10112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:34.576893 10112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260204 09:11:34.576921 10112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:34.580271 10112 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.3:46063
I20260204 09:11:34.580317 10921 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.224.3:46063 every 8 connection(s)
I20260204 09:11:34.582863 10922 heartbeater.cc:344] Connected to a master server at 127.9.224.62:42277
I20260204 09:11:34.582912 10922 heartbeater.cc:461] Registering TS with master...
I20260204 09:11:34.582984 10922 heartbeater.cc:507] Master 127.9.224.62:42277 requested a full tablet report, sending...
I20260204 09:11:34.583184 10642 ts_manager.cc:194] Registered new tserver with Master: 410861e0f65b4777a1e91bc3129fe211 (127.9.224.3:46063)
I20260204 09:11:34.583475 10642 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37534
I20260204 09:11:34.583717 10112 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003280129s
I20260204 09:11:34.593567 10642 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37554:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260204 09:11:34.593698 10642 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260204 09:11:34.598107 10886 tablet_service.cc:1505] Processing CreateTablet for tablet b7f9164e7670448282985c3ee263c176 (DEFAULT_TABLE table=test-workload [id=3b24785d8e0447c29f5a497dde386933]), partition=RANGE (key) PARTITION UNBOUNDED
I20260204 09:11:34.598237 10886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f9164e7670448282985c3ee263c176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 09:11:34.598464 10811 tablet_service.cc:1505] Processing CreateTablet for tablet b7f9164e7670448282985c3ee263c176 (DEFAULT_TABLE table=test-workload [id=3b24785d8e0447c29f5a497dde386933]), partition=RANGE (key) PARTITION UNBOUNDED
I20260204 09:11:34.598572 10811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f9164e7670448282985c3ee263c176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 09:11:34.598870 10735 tablet_service.cc:1505] Processing CreateTablet for tablet b7f9164e7670448282985c3ee263c176 (DEFAULT_TABLE table=test-workload [id=3b24785d8e0447c29f5a497dde386933]), partition=RANGE (key) PARTITION UNBOUNDED
I20260204 09:11:34.598956 10735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f9164e7670448282985c3ee263c176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 09:11:34.599452 10943 tablet_bootstrap.cc:492] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211: Bootstrap starting.
I20260204 09:11:34.599956 10944 tablet_bootstrap.cc:492] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa: Bootstrap starting.
I20260204 09:11:34.600008 10943 tablet_bootstrap.cc:654] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211: Neither blocks nor log segments found. Creating new log.
I20260204 09:11:34.600137 10945 tablet_bootstrap.cc:492] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc: Bootstrap starting.
I20260204 09:11:34.600402 10944 tablet_bootstrap.cc:654] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa: Neither blocks nor log segments found. Creating new log.
I20260204 09:11:34.600613 10945 tablet_bootstrap.cc:654] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc: Neither blocks nor log segments found. Creating new log.
I20260204 09:11:34.600967 10944 tablet_bootstrap.cc:492] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa: No bootstrap required, opened a new log
I20260204 09:11:34.601016 10944 ts_tablet_manager.cc:1403] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260204 09:11:34.601092 10945 tablet_bootstrap.cc:492] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc: No bootstrap required, opened a new log
I20260204 09:11:34.601131 10945 ts_tablet_manager.cc:1403] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260204 09:11:34.601162 10944 raft_consensus.cc:359] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:34.601227 10944 raft_consensus.cc:385] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 09:11:34.601249 10945 raft_consensus.cc:359] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:34.601253 10944 raft_consensus.cc:740] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 569cc1b853df4850b68d0e630e2ccafa, State: Initialized, Role: FOLLOWER
I20260204 09:11:34.601346 10945 raft_consensus.cc:385] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 09:11:34.601404 10943 tablet_bootstrap.cc:492] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211: No bootstrap required, opened a new log
I20260204 09:11:34.601441 10943 ts_tablet_manager.cc:1403] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260204 09:11:34.601418 10944 consensus_queue.cc:260] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:34.601424 10945 raft_consensus.cc:740] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221661cb244d40738b986866c02b37fc, State: Initialized, Role: FOLLOWER
I20260204 09:11:34.601640 10944 ts_tablet_manager.cc:1434] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260204 09:11:34.601640 10943 raft_consensus.cc:359] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:34.601686 10847 heartbeater.cc:499] Master 127.9.224.62:42277 was elected leader, sending a full tablet report...
I20260204 09:11:34.601738 10945 consensus_queue.cc:260] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:34.601758 10943 raft_consensus.cc:385] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 09:11:34.601799 10943 raft_consensus.cc:740] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 410861e0f65b4777a1e91bc3129fe211, State: Initialized, Role: FOLLOWER
I20260204 09:11:34.601854 10943 consensus_queue.cc:260] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:34.601907 10945 ts_tablet_manager.cc:1434] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260204 09:11:34.601994 10771 heartbeater.cc:499] Master 127.9.224.62:42277 was elected leader, sending a full tablet report...
I20260204 09:11:34.602120 10943 ts_tablet_manager.cc:1434] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260204 09:11:34.602154 10922 heartbeater.cc:499] Master 127.9.224.62:42277 was elected leader, sending a full tablet report...
I20260204 09:11:34.626665 10949 raft_consensus.cc:493] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:11:34.626754 10949 raft_consensus.cc:515] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:34.626950 10949 leader_election.cc:290] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221661cb244d40738b986866c02b37fc (127.9.224.1:42423), 410861e0f65b4777a1e91bc3129fe211 (127.9.224.3:46063)
I20260204 09:11:34.629283 10745 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "569cc1b853df4850b68d0e630e2ccafa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221661cb244d40738b986866c02b37fc" is_pre_election: true
I20260204 09:11:34.629396 10745 raft_consensus.cc:2468] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 569cc1b853df4850b68d0e630e2ccafa in term 0.
I20260204 09:11:34.629552 10896 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "569cc1b853df4850b68d0e630e2ccafa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "410861e0f65b4777a1e91bc3129fe211" is_pre_election: true
I20260204 09:11:34.629576 10786 leader_election.cc:304] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221661cb244d40738b986866c02b37fc, 569cc1b853df4850b68d0e630e2ccafa; no voters:
I20260204 09:11:34.629642 10896 raft_consensus.cc:2468] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 569cc1b853df4850b68d0e630e2ccafa in term 0.
I20260204 09:11:34.629720 10949 raft_consensus.cc:2804] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 09:11:34.629822 10949 raft_consensus.cc:493] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:34.629859 10949 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 0 FOLLOWER]: Advancing to term 1
I20260204 09:11:34.630460 10949 raft_consensus.cc:515] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:34.630573 10949 leader_election.cc:290] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [CANDIDATE]: Term 1 election: Requested vote from peers 221661cb244d40738b986866c02b37fc (127.9.224.1:42423), 410861e0f65b4777a1e91bc3129fe211 (127.9.224.3:46063)
I20260204 09:11:34.630702 10745 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "569cc1b853df4850b68d0e630e2ccafa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221661cb244d40738b986866c02b37fc"
I20260204 09:11:34.630731 10896 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "569cc1b853df4850b68d0e630e2ccafa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "410861e0f65b4777a1e91bc3129fe211"
I20260204 09:11:34.630785 10896 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 0 FOLLOWER]: Advancing to term 1
I20260204 09:11:34.630774 10745 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 0 FOLLOWER]: Advancing to term 1
I20260204 09:11:34.631487 10896 raft_consensus.cc:2468] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 569cc1b853df4850b68d0e630e2ccafa in term 1.
I20260204 09:11:34.631487 10745 raft_consensus.cc:2468] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 569cc1b853df4850b68d0e630e2ccafa in term 1.
I20260204 09:11:34.631652 10786 leader_election.cc:304] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221661cb244d40738b986866c02b37fc, 569cc1b853df4850b68d0e630e2ccafa; no voters:
I20260204 09:11:34.631737 10949 raft_consensus.cc:2804] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 1 FOLLOWER]: Leader election won for term 1
I20260204 09:11:34.631891 10949 raft_consensus.cc:697] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 1 LEADER]: Becoming Leader. State: Replica: 569cc1b853df4850b68d0e630e2ccafa, State: Running, Role: LEADER
I20260204 09:11:34.631942 10949 consensus_queue.cc:237] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:34.632403 10641 catalog_manager.cc:5654] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa reported cstate change: term changed from 0 to 1, leader changed from <none> to 569cc1b853df4850b68d0e630e2ccafa (127.9.224.2). New cstate: current_term: 1 leader_uuid: "569cc1b853df4850b68d0e630e2ccafa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:34.643507 10745 raft_consensus.cc:1275] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 1 FOLLOWER]: Refusing update from remote peer 569cc1b853df4850b68d0e630e2ccafa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 09:11:34.643541 10896 raft_consensus.cc:1275] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 1 FOLLOWER]: Refusing update from remote peer 569cc1b853df4850b68d0e630e2ccafa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 09:11:34.643692 10953 consensus_queue.cc:1048] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [LEADER]: Connected to new peer: Peer: permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 09:11:34.643782 10949 consensus_queue.cc:1048] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [LEADER]: Connected to new peer: Peer: permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 09:11:34.644887 10960 mvcc.cc:204] Tried to move back new op lower bound from 7250724022858698752 to 7250724022812893184. Current Snapshot: MvccSnapshot[applied={T|T < 7250724022858698752}]
I20260204 09:11:34.927446 10950 raft_consensus.cc:493] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 569cc1b853df4850b68d0e630e2ccafa)
I20260204 09:11:34.927538 10950 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 1 FOLLOWER]: Advancing to term 2
I20260204 09:11:34.928220 10950 raft_consensus.cc:515] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:34.928431 10950 leader_election.cc:290] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [CANDIDATE]: Term 2 election: Requested vote from peers 569cc1b853df4850b68d0e630e2ccafa (127.9.224.2:43003), 410861e0f65b4777a1e91bc3129fe211 (127.9.224.3:46063)
I20260204 09:11:34.930941 10896 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "221661cb244d40738b986866c02b37fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 18 } } ignore_live_leader: false dest_uuid: "410861e0f65b4777a1e91bc3129fe211"
I20260204 09:11:34.931107 10821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "221661cb244d40738b986866c02b37fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 18 } } ignore_live_leader: false dest_uuid: "569cc1b853df4850b68d0e630e2ccafa"
I20260204 09:11:34.931324 10710 leader_election.cc:304] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 221661cb244d40738b986866c02b37fc; no voters: 410861e0f65b4777a1e91bc3129fe211, 569cc1b853df4850b68d0e630e2ccafa
I20260204 09:11:34.931421 10950 raft_consensus.cc:2749] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260204 09:11:34.945750 10745 raft_consensus.cc:1240] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 2 FOLLOWER]: Rejecting Update request from peer 569cc1b853df4850b68d0e630e2ccafa for earlier term 1. Current term is 2. Ops: []
I20260204 09:11:34.946070 10965 consensus_queue.cc:1059] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 }, Status: INVALID_TERM, Last received: 1.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260204 09:11:34.952584 10951 raft_consensus.cc:493] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 569cc1b853df4850b68d0e630e2ccafa)
I20260204 09:11:34.952646 10951 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 1 FOLLOWER]: Advancing to term 2
I20260204 09:11:34.953280 10951 raft_consensus.cc:515] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:34.953447 10951 leader_election.cc:290] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [CANDIDATE]: Term 2 election: Requested vote from peers 569cc1b853df4850b68d0e630e2ccafa (127.9.224.2:43003), 221661cb244d40738b986866c02b37fc (127.9.224.1:42423)
I20260204 09:11:34.956063 10821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "410861e0f65b4777a1e91bc3129fe211" candidate_term: 2 candidate_status { last_received { term: 1 index: 18 } } ignore_live_leader: false dest_uuid: "569cc1b853df4850b68d0e630e2ccafa"
I20260204 09:11:34.956283 10745 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "410861e0f65b4777a1e91bc3129fe211" candidate_term: 2 candidate_status { last_received { term: 1 index: 18 } } ignore_live_leader: false dest_uuid: "221661cb244d40738b986866c02b37fc"
I20260204 09:11:34.956364 10745 raft_consensus.cc:2393] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 410861e0f65b4777a1e91bc3129fe211 in current term 2: Already voted for candidate 221661cb244d40738b986866c02b37fc in this term.
I20260204 09:11:34.956489 10861 leader_election.cc:304] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 410861e0f65b4777a1e91bc3129fe211; no voters: 221661cb244d40738b986866c02b37fc, 569cc1b853df4850b68d0e630e2ccafa
I20260204 09:11:34.956578 10951 raft_consensus.cc:2749] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260204 09:11:34.962735 10896 raft_consensus.cc:1240] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 2 FOLLOWER]: Rejecting Update request from peer 569cc1b853df4850b68d0e630e2ccafa for earlier term 1. Current term is 2. Ops: []
I20260204 09:11:34.962952 10965 consensus_queue.cc:1059] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 }, Status: INVALID_TERM, Last received: 1.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260204 09:11:34.971278 10953 raft_consensus.cc:3055] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 1 LEADER]: Stepping down as leader of term 1
I20260204 09:11:34.971330 10953 raft_consensus.cc:740] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 569cc1b853df4850b68d0e630e2ccafa, State: Running, Role: LEADER
I20260204 09:11:34.971390 10953 consensus_queue.cc:260] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 1.18, Last appended by leader: 18, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:34.971472 10953 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 1 FOLLOWER]: Advancing to term 2
I20260204 09:11:35.052794 10950 raft_consensus.cc:493] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:35.052907 10950 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 2 FOLLOWER]: Advancing to term 3
I20260204 09:11:35.053663 10950 raft_consensus.cc:515] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:35.053843 10950 leader_election.cc:290] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [CANDIDATE]: Term 3 election: Requested vote from peers 569cc1b853df4850b68d0e630e2ccafa (127.9.224.2:43003), 410861e0f65b4777a1e91bc3129fe211 (127.9.224.3:46063)
I20260204 09:11:35.054057 10821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "221661cb244d40738b986866c02b37fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 18 } } ignore_live_leader: false dest_uuid: "569cc1b853df4850b68d0e630e2ccafa"
I20260204 09:11:35.054057 10896 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "221661cb244d40738b986866c02b37fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 18 } } ignore_live_leader: false dest_uuid: "410861e0f65b4777a1e91bc3129fe211"
I20260204 09:11:35.054157 10821 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 2 FOLLOWER]: Advancing to term 3
I20260204 09:11:35.054160 10896 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 2 FOLLOWER]: Advancing to term 3
I20260204 09:11:35.054890 10896 raft_consensus.cc:2468] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221661cb244d40738b986866c02b37fc in term 3.
I20260204 09:11:35.054890 10821 raft_consensus.cc:2468] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221661cb244d40738b986866c02b37fc in term 3.
I20260204 09:11:35.055092 10710 leader_election.cc:304] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221661cb244d40738b986866c02b37fc, 569cc1b853df4850b68d0e630e2ccafa; no voters:
I20260204 09:11:35.055294 10950 raft_consensus.cc:2804] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 3 FOLLOWER]: Leader election won for term 3
I20260204 09:11:35.055433 10950 raft_consensus.cc:697] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 3 LEADER]: Becoming Leader. State: Replica: 221661cb244d40738b986866c02b37fc, State: Running, Role: LEADER
I20260204 09:11:35.055500 10950 consensus_queue.cc:237] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 1.18, Last appended by leader: 18, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:35.055936 10641 catalog_manager.cc:5654] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc reported cstate change: term changed from 1 to 3, leader changed from 569cc1b853df4850b68d0e630e2ccafa (127.9.224.2) to 221661cb244d40738b986866c02b37fc (127.9.224.1). New cstate: current_term: 3 leader_uuid: "221661cb244d40738b986866c02b37fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:35.141295 10896 raft_consensus.cc:1275] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 3 FOLLOWER]: Refusing update from remote peer 221661cb244d40738b986866c02b37fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 18. Preceding OpId from leader: term: 3 index: 19. (index mismatch)
I20260204 09:11:35.141557 10950 consensus_queue.cc:1048] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260204 09:11:35.142551 10821 raft_consensus.cc:1275] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 3 FOLLOWER]: Refusing update from remote peer 221661cb244d40738b986866c02b37fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 18. Preceding OpId from leader: term: 3 index: 19. (index mismatch)
I20260204 09:11:35.142729 10980 consensus_queue.cc:1048] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260204 09:11:35.261301 10951 raft_consensus.cc:493] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 221661cb244d40738b986866c02b37fc)
I20260204 09:11:35.261425 10951 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 3 FOLLOWER]: Advancing to term 4
I20260204 09:11:35.262070 10951 raft_consensus.cc:515] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:35.262229 10951 leader_election.cc:290] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [CANDIDATE]: Term 4 election: Requested vote from peers 569cc1b853df4850b68d0e630e2ccafa (127.9.224.2:43003), 221661cb244d40738b986866c02b37fc (127.9.224.1:42423)
I20260204 09:11:35.262447 10745 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "410861e0f65b4777a1e91bc3129fe211" candidate_term: 4 candidate_status { last_received { term: 3 index: 19 } } ignore_live_leader: false dest_uuid: "221661cb244d40738b986866c02b37fc"
I20260204 09:11:35.262447 10821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "410861e0f65b4777a1e91bc3129fe211" candidate_term: 4 candidate_status { last_received { term: 3 index: 19 } } ignore_live_leader: false dest_uuid: "569cc1b853df4850b68d0e630e2ccafa"
I20260204 09:11:35.262746 10861 leader_election.cc:304] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 410861e0f65b4777a1e91bc3129fe211; no voters: 221661cb244d40738b986866c02b37fc, 569cc1b853df4850b68d0e630e2ccafa
I20260204 09:11:35.262828 10951 raft_consensus.cc:2749] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260204 09:11:35.267448 10896 raft_consensus.cc:1240] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 4 FOLLOWER]: Rejecting Update request from peer 221661cb244d40738b986866c02b37fc for earlier term 3. Current term is 4. Ops: []
I20260204 09:11:35.267628 10950 consensus_queue.cc:1059] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 }, Status: INVALID_TERM, Last received: 3.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260204 09:11:35.357895 10896 raft_consensus.cc:1240] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 4 FOLLOWER]: Rejecting Update request from peer 221661cb244d40738b986866c02b37fc for earlier term 3. Current term is 4. Ops: []
I20260204 09:11:35.358141 10950 consensus_queue.cc:1059] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 }, Status: INVALID_TERM, Last received: 3.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260204 09:11:35.359819 10980 raft_consensus.cc:3055] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 3 LEADER]: Stepping down as leader of term 3
I20260204 09:11:35.359879 10980 raft_consensus.cc:740] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 221661cb244d40738b986866c02b37fc, State: Running, Role: LEADER
I20260204 09:11:35.359935 10980 consensus_queue.cc:260] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 3.19, Last appended by leader: 19, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:35.360023 10980 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 3 FOLLOWER]: Advancing to term 4
I20260204 09:11:35.368176 10951 raft_consensus.cc:493] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:35.368258 10951 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:11:35.368913 10951 raft_consensus.cc:515] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:35.369061 10951 leader_election.cc:290] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [CANDIDATE]: Term 5 election: Requested vote from peers 569cc1b853df4850b68d0e630e2ccafa (127.9.224.2:43003), 221661cb244d40738b986866c02b37fc (127.9.224.1:42423)
I20260204 09:11:35.369266 10745 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "410861e0f65b4777a1e91bc3129fe211" candidate_term: 5 candidate_status { last_received { term: 3 index: 19 } } ignore_live_leader: false dest_uuid: "221661cb244d40738b986866c02b37fc"
I20260204 09:11:35.369238 10821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "410861e0f65b4777a1e91bc3129fe211" candidate_term: 5 candidate_status { last_received { term: 3 index: 19 } } ignore_live_leader: false dest_uuid: "569cc1b853df4850b68d0e630e2ccafa"
I20260204 09:11:35.369333 10745 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:11:35.369911 10745 raft_consensus.cc:2468] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 410861e0f65b4777a1e91bc3129fe211 in term 5.
I20260204 09:11:35.370080 10861 leader_election.cc:304] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221661cb244d40738b986866c02b37fc, 410861e0f65b4777a1e91bc3129fe211; no voters: 569cc1b853df4850b68d0e630e2ccafa
I20260204 09:11:35.370162 10951 raft_consensus.cc:2804] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 5 FOLLOWER]: Leader election won for term 5
I20260204 09:11:35.370277 10951 raft_consensus.cc:697] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 5 LEADER]: Becoming Leader. State: Replica: 410861e0f65b4777a1e91bc3129fe211, State: Running, Role: LEADER
I20260204 09:11:35.370330 10951 consensus_queue.cc:237] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 3.19, Last appended by leader: 19, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:35.370774 10640 catalog_manager.cc:5654] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 reported cstate change: term changed from 3 to 5, leader changed from 221661cb244d40738b986866c02b37fc (127.9.224.1) to 410861e0f65b4777a1e91bc3129fe211 (127.9.224.3). New cstate: current_term: 5 leader_uuid: "410861e0f65b4777a1e91bc3129fe211" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:35.407981 10953 raft_consensus.cc:493] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 3 FOLLOWER]: Starting leader election (detected failure of leader 221661cb244d40738b986866c02b37fc)
I20260204 09:11:35.408073 10953 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 3 FOLLOWER]: Advancing to term 4
I20260204 09:11:35.408761 10953 raft_consensus.cc:515] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:35.408926 10953 leader_election.cc:290] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [CANDIDATE]: Term 4 election: Requested vote from peers 221661cb244d40738b986866c02b37fc (127.9.224.1:42423), 410861e0f65b4777a1e91bc3129fe211 (127.9.224.3:46063)
I20260204 09:11:35.409116 10745 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "569cc1b853df4850b68d0e630e2ccafa" candidate_term: 4 candidate_status { last_received { term: 3 index: 19 } } ignore_live_leader: false dest_uuid: "221661cb244d40738b986866c02b37fc"
I20260204 09:11:35.409116 10896 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "569cc1b853df4850b68d0e630e2ccafa" candidate_term: 4 candidate_status { last_received { term: 3 index: 19 } } ignore_live_leader: false dest_uuid: "410861e0f65b4777a1e91bc3129fe211"
I20260204 09:11:35.409243 10745 raft_consensus.cc:2368] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 569cc1b853df4850b68d0e630e2ccafa for earlier term 4. Current term is 5.
I20260204 09:11:35.409435 10786 leader_election.cc:400] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [CANDIDATE]: Term 4 election: Vote denied by peer 221661cb244d40738b986866c02b37fc (127.9.224.1:42423) with higher term. Message: Invalid argument: T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 569cc1b853df4850b68d0e630e2ccafa for earlier term 4. Current term is 5.
I20260204 09:11:35.409474 10786 leader_election.cc:403] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260204 09:11:35.409530 10953 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 4 FOLLOWER]: Advancing to term 5
I20260204 09:11:35.410005 10953 raft_consensus.cc:2749] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 221661cb244d40738b986866c02b37fc (127.9.224.1:42423) with higher term. Message: Invalid argument: T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 569cc1b853df4850b68d0e630e2ccafa for earlier term 4. Current term is 5.
I20260204 09:11:35.465113 10745 raft_consensus.cc:1275] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 5 FOLLOWER]: Refusing update from remote peer 410861e0f65b4777a1e91bc3129fe211: Log matching property violated. Preceding OpId in replica: term: 3 index: 19. Preceding OpId from leader: term: 5 index: 20. (index mismatch)
I20260204 09:11:35.465346 10951 consensus_queue.cc:1048] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260204 09:11:35.486258 10821 raft_consensus.cc:1275] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 5 FOLLOWER]: Refusing update from remote peer 410861e0f65b4777a1e91bc3129fe211: Log matching property violated. Preceding OpId in replica: term: 3 index: 19. Preceding OpId from leader: term: 5 index: 20. (index mismatch)
I20260204 09:11:35.486552 10951 consensus_queue.cc:1048] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260204 09:11:35.587595 10953 raft_consensus.cc:493] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 5 FOLLOWER]: Starting leader election (detected failure of leader 410861e0f65b4777a1e91bc3129fe211)
I20260204 09:11:35.587680 10953 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:11:35.588266 10953 raft_consensus.cc:515] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:35.588428 10953 leader_election.cc:290] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [CANDIDATE]: Term 6 election: Requested vote from peers 221661cb244d40738b986866c02b37fc (127.9.224.1:42423), 410861e0f65b4777a1e91bc3129fe211 (127.9.224.3:46063)
I20260204 09:11:35.588639 10896 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "569cc1b853df4850b68d0e630e2ccafa" candidate_term: 6 candidate_status { last_received { term: 5 index: 20 } } ignore_live_leader: false dest_uuid: "410861e0f65b4777a1e91bc3129fe211"
I20260204 09:11:35.588652 10745 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "569cc1b853df4850b68d0e630e2ccafa" candidate_term: 6 candidate_status { last_received { term: 5 index: 20 } } ignore_live_leader: false dest_uuid: "221661cb244d40738b986866c02b37fc"
I20260204 09:11:35.588903 10786 leader_election.cc:304] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 569cc1b853df4850b68d0e630e2ccafa; no voters: 221661cb244d40738b986866c02b37fc, 410861e0f65b4777a1e91bc3129fe211
I20260204 09:11:35.588985 10953 raft_consensus.cc:2749] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260204 09:11:35.606599 10821 raft_consensus.cc:1240] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 6 FOLLOWER]: Rejecting Update request from peer 410861e0f65b4777a1e91bc3129fe211 for earlier term 5. Current term is 6. Ops: []
I20260204 09:11:35.606829 10983 consensus_queue.cc:1059] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 }, Status: INVALID_TERM, Last received: 5.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260204 09:11:35.608042 10983 raft_consensus.cc:3055] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 5 LEADER]: Stepping down as leader of term 5
I20260204 09:11:35.608088 10983 raft_consensus.cc:740] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 410861e0f65b4777a1e91bc3129fe211, State: Running, Role: LEADER
I20260204 09:11:35.608142 10983 consensus_queue.cc:260] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 5.20, Last appended by leader: 20, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:35.608227 10983 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:11:35.676011 10980 raft_consensus.cc:493] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 410861e0f65b4777a1e91bc3129fe211)
I20260204 09:11:35.676115 10980 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 5 FOLLOWER]: Advancing to term 6
I20260204 09:11:35.676738 10980 raft_consensus.cc:515] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:35.676885 10980 leader_election.cc:290] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [CANDIDATE]: Term 6 election: Requested vote from peers 569cc1b853df4850b68d0e630e2ccafa (127.9.224.2:43003), 410861e0f65b4777a1e91bc3129fe211 (127.9.224.3:46063)
I20260204 09:11:35.677101 10896 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "221661cb244d40738b986866c02b37fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 20 } } ignore_live_leader: false dest_uuid: "410861e0f65b4777a1e91bc3129fe211"
I20260204 09:11:35.677098 10821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "221661cb244d40738b986866c02b37fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 20 } } ignore_live_leader: false dest_uuid: "569cc1b853df4850b68d0e630e2ccafa"
I20260204 09:11:35.677225 10821 raft_consensus.cc:2393] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 221661cb244d40738b986866c02b37fc in current term 6: Already voted for candidate 569cc1b853df4850b68d0e630e2ccafa in this term.
I20260204 09:11:35.677807 10896 raft_consensus.cc:2468] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221661cb244d40738b986866c02b37fc in term 6.
I20260204 09:11:35.677973 10711 leader_election.cc:304] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221661cb244d40738b986866c02b37fc, 410861e0f65b4777a1e91bc3129fe211; no voters: 569cc1b853df4850b68d0e630e2ccafa
I20260204 09:11:35.678064 10980 raft_consensus.cc:2804] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 6 FOLLOWER]: Leader election won for term 6
I20260204 09:11:35.678112 10980 raft_consensus.cc:697] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 6 LEADER]: Becoming Leader. State: Replica: 221661cb244d40738b986866c02b37fc, State: Running, Role: LEADER
I20260204 09:11:35.678155 10980 consensus_queue.cc:237] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 5.20, Last appended by leader: 20, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:35.678579 10640 catalog_manager.cc:5654] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc reported cstate change: term changed from 5 to 6, leader changed from 410861e0f65b4777a1e91bc3129fe211 (127.9.224.3) to 221661cb244d40738b986866c02b37fc (127.9.224.1). New cstate: current_term: 6 leader_uuid: "221661cb244d40738b986866c02b37fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:35.733394 10953 raft_consensus.cc:493] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:35.733484 10953 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:11:35.734061 10953 raft_consensus.cc:515] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:35.734211 10953 leader_election.cc:290] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [CANDIDATE]: Term 7 election: Requested vote from peers 221661cb244d40738b986866c02b37fc (127.9.224.1:42423), 410861e0f65b4777a1e91bc3129fe211 (127.9.224.3:46063)
I20260204 09:11:35.734427 10745 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "569cc1b853df4850b68d0e630e2ccafa" candidate_term: 7 candidate_status { last_received { term: 5 index: 20 } } ignore_live_leader: false dest_uuid: "221661cb244d40738b986866c02b37fc"
I20260204 09:11:35.734439 10896 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "569cc1b853df4850b68d0e630e2ccafa" candidate_term: 7 candidate_status { last_received { term: 5 index: 20 } } ignore_live_leader: false dest_uuid: "410861e0f65b4777a1e91bc3129fe211"
I20260204 09:11:35.734575 10896 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:11:35.735086 10896 raft_consensus.cc:2468] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 569cc1b853df4850b68d0e630e2ccafa in term 7.
I20260204 09:11:35.735244 10787 leader_election.cc:304] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 410861e0f65b4777a1e91bc3129fe211, 569cc1b853df4850b68d0e630e2ccafa; no voters: 221661cb244d40738b986866c02b37fc
I20260204 09:11:35.735365 10953 raft_consensus.cc:2804] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 7 FOLLOWER]: Leader election won for term 7
I20260204 09:11:35.735494 10953 raft_consensus.cc:697] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 7 LEADER]: Becoming Leader. State: Replica: 569cc1b853df4850b68d0e630e2ccafa, State: Running, Role: LEADER
I20260204 09:11:35.735549 10953 consensus_queue.cc:237] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 5.20, Last appended by leader: 20, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:35.740309 10642 catalog_manager.cc:5654] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa reported cstate change: term changed from 6 to 7, leader changed from 221661cb244d40738b986866c02b37fc (127.9.224.1) to 569cc1b853df4850b68d0e630e2ccafa (127.9.224.2). New cstate: current_term: 7 leader_uuid: "569cc1b853df4850b68d0e630e2ccafa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:35.766866 10821 raft_consensus.cc:1240] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 7 LEADER]: Rejecting Update request from peer 221661cb244d40738b986866c02b37fc for earlier term 6. Current term is 7. Ops: []
I20260204 09:11:35.767108 10980 consensus_queue.cc:1059] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260204 09:11:35.767206 10980 consensus_queue.cc:1243] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [LEADER]: Peer 569cc1b853df4850b68d0e630e2ccafa log is divergent from this leader: its last log entry 7.21 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 20
I20260204 09:11:35.781138 10896 raft_consensus.cc:1240] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 7 FOLLOWER]: Rejecting Update request from peer 221661cb244d40738b986866c02b37fc for earlier term 6. Current term is 7. Ops: []
I20260204 09:11:35.781412 10980 consensus_queue.cc:1059] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260204 09:11:35.809311 10950 raft_consensus.cc:3055] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 6 LEADER]: Stepping down as leader of term 6
I20260204 09:11:35.809432 10950 raft_consensus.cc:740] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 221661cb244d40738b986866c02b37fc, State: Running, Role: LEADER
I20260204 09:11:35.809516 10950 consensus_queue.cc:260] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 6.21, Last appended by leader: 21, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:35.809624 10950 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 6 FOLLOWER]: Advancing to term 7
I20260204 09:11:35.832788 10745 raft_consensus.cc:1275] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 7 FOLLOWER]: Refusing update from remote peer 569cc1b853df4850b68d0e630e2ccafa: Log matching property violated. Preceding OpId in replica: term: 6 index: 21. Preceding OpId from leader: term: 7 index: 21. (term mismatch)
I20260204 09:11:35.832864 10745 pending_rounds.cc:85] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc: Aborting all ops after (but not including) 20
I20260204 09:11:35.832876 10745 pending_rounds.cc:107] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc: Aborting uncommitted NO_OP operation due to leader change: 6.21
I20260204 09:11:35.832890 10745 raft_consensus.cc:2889] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:35.833096 10953 consensus_queue.cc:1048] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [LEADER]: Connected to new peer: Peer: permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260204 09:11:35.853266 10896 raft_consensus.cc:1275] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 7 FOLLOWER]: Refusing update from remote peer 569cc1b853df4850b68d0e630e2ccafa: Log matching property violated. Preceding OpId in replica: term: 5 index: 20. Preceding OpId from leader: term: 7 index: 21. (index mismatch)
I20260204 09:11:35.853521 10953 consensus_queue.cc:1048] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [LEADER]: Connected to new peer: Peer: permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260204 09:11:36.143499 10983 raft_consensus.cc:493] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 569cc1b853df4850b68d0e630e2ccafa)
I20260204 09:11:36.143610 10983 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 7 FOLLOWER]: Advancing to term 8
I20260204 09:11:36.144249 10983 raft_consensus.cc:515] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:36.144408 10983 leader_election.cc:290] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [CANDIDATE]: Term 8 election: Requested vote from peers 569cc1b853df4850b68d0e630e2ccafa (127.9.224.2:43003), 221661cb244d40738b986866c02b37fc (127.9.224.1:42423)
I20260204 09:11:36.144663 10821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "410861e0f65b4777a1e91bc3129fe211" candidate_term: 8 candidate_status { last_received { term: 7 index: 21 } } ignore_live_leader: false dest_uuid: "569cc1b853df4850b68d0e630e2ccafa"
I20260204 09:11:36.144676 10745 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "410861e0f65b4777a1e91bc3129fe211" candidate_term: 8 candidate_status { last_received { term: 7 index: 21 } } ignore_live_leader: false dest_uuid: "221661cb244d40738b986866c02b37fc"
I20260204 09:11:36.144963 10861 leader_election.cc:304] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 410861e0f65b4777a1e91bc3129fe211; no voters: 221661cb244d40738b986866c02b37fc, 569cc1b853df4850b68d0e630e2ccafa
I20260204 09:11:36.145082 10983 raft_consensus.cc:2749] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260204 09:11:36.161129 10896 raft_consensus.cc:1240] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 8 FOLLOWER]: Rejecting Update request from peer 569cc1b853df4850b68d0e630e2ccafa for earlier term 7. Current term is 8. Ops: []
I20260204 09:11:36.161382 10985 consensus_queue.cc:1059] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 }, Status: INVALID_TERM, Last received: 7.21, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260204 09:11:36.200644 10953 raft_consensus.cc:3055] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 7 LEADER]: Stepping down as leader of term 7
I20260204 09:11:36.200728 10953 raft_consensus.cc:740] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 569cc1b853df4850b68d0e630e2ccafa, State: Running, Role: LEADER
I20260204 09:11:36.200789 10953 consensus_queue.cc:260] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 7.21, Last appended by leader: 21, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:36.200889 10953 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 7 FOLLOWER]: Advancing to term 8
I20260204 09:11:36.214287 10950 raft_consensus.cc:493] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 569cc1b853df4850b68d0e630e2ccafa)
I20260204 09:11:36.214380 10950 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 7 FOLLOWER]: Advancing to term 8
I20260204 09:11:36.215018 10950 raft_consensus.cc:515] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:36.215180 10950 leader_election.cc:290] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [CANDIDATE]: Term 8 election: Requested vote from peers 569cc1b853df4850b68d0e630e2ccafa (127.9.224.2:43003), 410861e0f65b4777a1e91bc3129fe211 (127.9.224.3:46063)
I20260204 09:11:36.215370 10821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "221661cb244d40738b986866c02b37fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 21 } } ignore_live_leader: false dest_uuid: "569cc1b853df4850b68d0e630e2ccafa"
I20260204 09:11:36.215382 10896 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "221661cb244d40738b986866c02b37fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 21 } } ignore_live_leader: false dest_uuid: "410861e0f65b4777a1e91bc3129fe211"
I20260204 09:11:36.215479 10896 raft_consensus.cc:2393] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 221661cb244d40738b986866c02b37fc in current term 8: Already voted for candidate 410861e0f65b4777a1e91bc3129fe211 in this term.
I20260204 09:11:36.216002 10821 raft_consensus.cc:2468] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221661cb244d40738b986866c02b37fc in term 8.
I20260204 09:11:36.216153 10710 leader_election.cc:304] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221661cb244d40738b986866c02b37fc, 569cc1b853df4850b68d0e630e2ccafa; no voters: 410861e0f65b4777a1e91bc3129fe211
I20260204 09:11:36.216240 10950 raft_consensus.cc:2804] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 8 FOLLOWER]: Leader election won for term 8
I20260204 09:11:36.216286 10950 raft_consensus.cc:697] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 8 LEADER]: Becoming Leader. State: Replica: 221661cb244d40738b986866c02b37fc, State: Running, Role: LEADER
I20260204 09:11:36.216333 10950 consensus_queue.cc:237] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 7.21, Last appended by leader: 21, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:36.216750 10642 catalog_manager.cc:5654] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc reported cstate change: term changed from 7 to 8, leader changed from 569cc1b853df4850b68d0e630e2ccafa (127.9.224.2) to 221661cb244d40738b986866c02b37fc (127.9.224.1). New cstate: current_term: 8 leader_uuid: "221661cb244d40738b986866c02b37fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:36.277613 10983 raft_consensus.cc:493] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:36.277700 10983 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 8 FOLLOWER]: Advancing to term 9
I20260204 09:11:36.278323 10983 raft_consensus.cc:515] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:36.278466 10983 leader_election.cc:290] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [CANDIDATE]: Term 9 election: Requested vote from peers 569cc1b853df4850b68d0e630e2ccafa (127.9.224.2:43003), 221661cb244d40738b986866c02b37fc (127.9.224.1:42423)
I20260204 09:11:36.278671 10821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "410861e0f65b4777a1e91bc3129fe211" candidate_term: 9 candidate_status { last_received { term: 7 index: 21 } } ignore_live_leader: false dest_uuid: "569cc1b853df4850b68d0e630e2ccafa"
I20260204 09:11:36.278681 10745 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "410861e0f65b4777a1e91bc3129fe211" candidate_term: 9 candidate_status { last_received { term: 7 index: 21 } } ignore_live_leader: false dest_uuid: "221661cb244d40738b986866c02b37fc"
I20260204 09:11:36.278766 10821 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 8 FOLLOWER]: Advancing to term 9
I20260204 09:11:36.279316 10821 raft_consensus.cc:2468] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 410861e0f65b4777a1e91bc3129fe211 in term 9.
I20260204 09:11:36.279485 10861 leader_election.cc:304] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 410861e0f65b4777a1e91bc3129fe211, 569cc1b853df4850b68d0e630e2ccafa; no voters: 221661cb244d40738b986866c02b37fc
I20260204 09:11:36.279567 10983 raft_consensus.cc:2804] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 9 FOLLOWER]: Leader election won for term 9
I20260204 09:11:36.279677 10983 raft_consensus.cc:697] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 9 LEADER]: Becoming Leader. State: Replica: 410861e0f65b4777a1e91bc3129fe211, State: Running, Role: LEADER
I20260204 09:11:36.279722 10983 consensus_queue.cc:237] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 7.21, Last appended by leader: 21, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:36.303505 10640 catalog_manager.cc:5654] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 reported cstate change: term changed from 8 to 9, leader changed from 221661cb244d40738b986866c02b37fc (127.9.224.1) to 410861e0f65b4777a1e91bc3129fe211 (127.9.224.3). New cstate: current_term: 9 leader_uuid: "410861e0f65b4777a1e91bc3129fe211" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:36.320040 10821 raft_consensus.cc:1240] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 9 FOLLOWER]: Rejecting Update request from peer 221661cb244d40738b986866c02b37fc for earlier term 8. Current term is 9. Ops: []
I20260204 09:11:36.320268 10950 consensus_queue.cc:1059] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260204 09:11:36.322343 10896 raft_consensus.cc:1240] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 9 LEADER]: Rejecting Update request from peer 221661cb244d40738b986866c02b37fc for earlier term 8. Current term is 9. Ops: []
I20260204 09:11:36.322551 10980 consensus_queue.cc:1059] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260204 09:11:36.322616 10980 consensus_queue.cc:1243] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [LEADER]: Peer 410861e0f65b4777a1e91bc3129fe211 log is divergent from this leader: its last log entry 9.22 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 21
I20260204 09:11:36.349465 10950 raft_consensus.cc:3055] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 8 LEADER]: Stepping down as leader of term 8
I20260204 09:11:36.349539 10950 raft_consensus.cc:740] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 221661cb244d40738b986866c02b37fc, State: Running, Role: LEADER
I20260204 09:11:36.349596 10950 consensus_queue.cc:260] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 8.22, Last appended by leader: 22, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:36.349677 10950 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 8 FOLLOWER]: Advancing to term 9
I20260204 09:11:36.375429 10745 raft_consensus.cc:1275] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 9 FOLLOWER]: Refusing update from remote peer 410861e0f65b4777a1e91bc3129fe211: Log matching property violated. Preceding OpId in replica: term: 8 index: 22. Preceding OpId from leader: term: 9 index: 22. (term mismatch)
I20260204 09:11:36.375496 10745 pending_rounds.cc:85] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc: Aborting all ops after (but not including) 21
I20260204 09:11:36.375509 10745 pending_rounds.cc:107] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc: Aborting uncommitted NO_OP operation due to leader change: 8.22
I20260204 09:11:36.375521 10745 raft_consensus.cc:2889] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260204 09:11:36.375708 10983 consensus_queue.cc:1048] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260204 09:11:36.376328 10821 raft_consensus.cc:1275] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 9 FOLLOWER]: Refusing update from remote peer 410861e0f65b4777a1e91bc3129fe211: Log matching property violated. Preceding OpId in replica: term: 7 index: 21. Preceding OpId from leader: term: 9 index: 22. (index mismatch)
I20260204 09:11:36.376497 10983 consensus_queue.cc:1048] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260204 09:11:36.733574 10950 raft_consensus.cc:493] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 410861e0f65b4777a1e91bc3129fe211)
I20260204 09:11:36.733670 10950 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 9 FOLLOWER]: Advancing to term 10
I20260204 09:11:36.734333 10950 raft_consensus.cc:515] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:36.734519 10950 leader_election.cc:290] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [CANDIDATE]: Term 10 election: Requested vote from peers 569cc1b853df4850b68d0e630e2ccafa (127.9.224.2:43003), 410861e0f65b4777a1e91bc3129fe211 (127.9.224.3:46063)
I20260204 09:11:36.734726 10821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "221661cb244d40738b986866c02b37fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 22 } } ignore_live_leader: false dest_uuid: "569cc1b853df4850b68d0e630e2ccafa"
I20260204 09:11:36.734726 10896 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "221661cb244d40738b986866c02b37fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 22 } } ignore_live_leader: false dest_uuid: "410861e0f65b4777a1e91bc3129fe211"
I20260204 09:11:36.734982 10710 leader_election.cc:304] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 221661cb244d40738b986866c02b37fc; no voters: 410861e0f65b4777a1e91bc3129fe211, 569cc1b853df4850b68d0e630e2ccafa
I20260204 09:11:36.735065 10950 raft_consensus.cc:2749] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260204 09:11:36.735930 10745 raft_consensus.cc:1240] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 10 FOLLOWER]: Rejecting Update request from peer 410861e0f65b4777a1e91bc3129fe211 for earlier term 9. Current term is 10. Ops: []
I20260204 09:11:36.736145 10989 consensus_queue.cc:1059] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 }, Status: INVALID_TERM, Last received: 9.22, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
I20260204 09:11:36.746135 10953 raft_consensus.cc:493] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 9 FOLLOWER]: Starting leader election (detected failure of leader 410861e0f65b4777a1e91bc3129fe211)
I20260204 09:11:36.746204 10953 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 9 FOLLOWER]: Advancing to term 10
I20260204 09:11:36.746840 10953 raft_consensus.cc:515] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:36.746980 10953 leader_election.cc:290] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [CANDIDATE]: Term 10 election: Requested vote from peers 221661cb244d40738b986866c02b37fc (127.9.224.1:42423), 410861e0f65b4777a1e91bc3129fe211 (127.9.224.3:46063)
I20260204 09:11:36.747133 10745 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "569cc1b853df4850b68d0e630e2ccafa" candidate_term: 10 candidate_status { last_received { term: 9 index: 22 } } ignore_live_leader: false dest_uuid: "221661cb244d40738b986866c02b37fc"
I20260204 09:11:36.747170 10896 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "569cc1b853df4850b68d0e630e2ccafa" candidate_term: 10 candidate_status { last_received { term: 9 index: 22 } } ignore_live_leader: false dest_uuid: "410861e0f65b4777a1e91bc3129fe211"
I20260204 09:11:36.747206 10745 raft_consensus.cc:2393] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 569cc1b853df4850b68d0e630e2ccafa in current term 10: Already voted for candidate 221661cb244d40738b986866c02b37fc in this term.
I20260204 09:11:36.747360 10787 leader_election.cc:304] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 569cc1b853df4850b68d0e630e2ccafa; no voters: 221661cb244d40738b986866c02b37fc, 410861e0f65b4777a1e91bc3129fe211
I20260204 09:11:36.747565 10953 raft_consensus.cc:2749] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260204 09:11:36.761538 10821 raft_consensus.cc:1240] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 10 FOLLOWER]: Rejecting Update request from peer 410861e0f65b4777a1e91bc3129fe211 for earlier term 9. Current term is 10. Ops: []
I20260204 09:11:36.761755 10989 consensus_queue.cc:1059] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 }, Status: INVALID_TERM, Last received: 9.22, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
I20260204 09:11:36.808359 10986 raft_consensus.cc:3055] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 9 LEADER]: Stepping down as leader of term 9
I20260204 09:11:36.808446 10986 raft_consensus.cc:740] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 410861e0f65b4777a1e91bc3129fe211, State: Running, Role: LEADER
I20260204 09:11:36.808521 10986 consensus_queue.cc:260] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 9.22, Last appended by leader: 22, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:36.808640 10986 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 9 FOLLOWER]: Advancing to term 10
I20260204 09:11:36.842406 10950 raft_consensus.cc:493] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:36.842521 10950 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 10 FOLLOWER]: Advancing to term 11
I20260204 09:11:36.843183 10950 raft_consensus.cc:515] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:36.843346 10950 leader_election.cc:290] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [CANDIDATE]: Term 11 election: Requested vote from peers 569cc1b853df4850b68d0e630e2ccafa (127.9.224.2:43003), 410861e0f65b4777a1e91bc3129fe211 (127.9.224.3:46063)
I20260204 09:11:36.843554 10896 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "221661cb244d40738b986866c02b37fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 22 } } ignore_live_leader: false dest_uuid: "410861e0f65b4777a1e91bc3129fe211"
I20260204 09:11:36.843550 10821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "221661cb244d40738b986866c02b37fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 22 } } ignore_live_leader: false dest_uuid: "569cc1b853df4850b68d0e630e2ccafa"
I20260204 09:11:36.843631 10896 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 10 FOLLOWER]: Advancing to term 11
I20260204 09:11:36.843660 10821 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 10 FOLLOWER]: Advancing to term 11
I20260204 09:11:36.844164 10896 raft_consensus.cc:2468] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221661cb244d40738b986866c02b37fc in term 11.
I20260204 09:11:36.844219 10821 raft_consensus.cc:2468] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221661cb244d40738b986866c02b37fc in term 11.
I20260204 09:11:36.844374 10711 leader_election.cc:304] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221661cb244d40738b986866c02b37fc, 410861e0f65b4777a1e91bc3129fe211; no voters:
I20260204 09:11:36.844460 10950 raft_consensus.cc:2804] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 11 FOLLOWER]: Leader election won for term 11
I20260204 09:11:36.844509 10950 raft_consensus.cc:697] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 11 LEADER]: Becoming Leader. State: Replica: 221661cb244d40738b986866c02b37fc, State: Running, Role: LEADER
I20260204 09:11:36.844573 10950 consensus_queue.cc:237] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 9.22, Last appended by leader: 22, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:36.844966 10642 catalog_manager.cc:5654] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc reported cstate change: term changed from 9 to 11, leader changed from 410861e0f65b4777a1e91bc3129fe211 (127.9.224.3) to 221661cb244d40738b986866c02b37fc (127.9.224.1). New cstate: current_term: 11 leader_uuid: "221661cb244d40738b986866c02b37fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:36.847818 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:36.848956 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:36.851068 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:36.855178 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:36.863291 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:36.879428 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:36.911608 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:36.937433 10821 raft_consensus.cc:1275] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 11 FOLLOWER]: Refusing update from remote peer 221661cb244d40738b986866c02b37fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 22. Preceding OpId from leader: term: 11 index: 23. (index mismatch)
I20260204 09:11:36.937686 10950 consensus_queue.cc:1048] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
I20260204 09:11:36.938675 10896 raft_consensus.cc:1275] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 11 FOLLOWER]: Refusing update from remote peer 221661cb244d40738b986866c02b37fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 22. Preceding OpId from leader: term: 11 index: 23. (index mismatch)
I20260204 09:11:36.938856 10950 consensus_queue.cc:1048] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
I20260204 09:11:36.975831 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:36.975956 10112 log_reader.cc:385] T b7f9164e7670448282985c3ee263c176: removed 1 log segments from log reader
I20260204 09:11:36.975978 10112 log.cc:1079] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc: Deleting log segment in path: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1770196261863819-10112-0/minicluster-data/ts-0-root/wals/b7f9164e7670448282985c3ee263c176/wal-000000001 (ops 1-18)
I20260204 09:11:36.976374 10112 timestamp_advancement-itest.cc:274] Shutting down cluster...
I20260204 09:11:36.976426 10112 master.cc:561] Master@127.9.224.62:42277 shutting down...
I20260204 09:11:37.039301 10953 raft_consensus.cc:493] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 11 FOLLOWER]: Starting leader election (detected failure of leader 221661cb244d40738b986866c02b37fc)
I20260204 09:11:37.039405 10953 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 11 FOLLOWER]: Advancing to term 12
I20260204 09:11:37.039983 10986 raft_consensus.cc:493] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 221661cb244d40738b986866c02b37fc)
I20260204 09:11:37.040056 10986 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 11 FOLLOWER]: Advancing to term 12
I20260204 09:11:37.040095 10953 raft_consensus.cc:515] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:37.040254 10953 leader_election.cc:290] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [CANDIDATE]: Term 12 election: Requested vote from peers 221661cb244d40738b986866c02b37fc (127.9.224.1:42423), 410861e0f65b4777a1e91bc3129fe211 (127.9.224.3:46063)
I20260204 09:11:37.040441 10896 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "569cc1b853df4850b68d0e630e2ccafa" candidate_term: 12 candidate_status { last_received { term: 11 index: 23 } } ignore_live_leader: false dest_uuid: "410861e0f65b4777a1e91bc3129fe211"
I20260204 09:11:37.040444 10745 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "569cc1b853df4850b68d0e630e2ccafa" candidate_term: 12 candidate_status { last_received { term: 11 index: 23 } } ignore_live_leader: false dest_uuid: "221661cb244d40738b986866c02b37fc"
I20260204 09:11:37.040796 10986 raft_consensus.cc:515] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:37.040902 10896 raft_consensus.cc:2393] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 569cc1b853df4850b68d0e630e2ccafa in current term 12: Already voted for candidate 410861e0f65b4777a1e91bc3129fe211 in this term.
I20260204 09:11:37.040908 10986 leader_election.cc:290] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [CANDIDATE]: Term 12 election: Requested vote from peers 569cc1b853df4850b68d0e630e2ccafa (127.9.224.2:43003), 221661cb244d40738b986866c02b37fc (127.9.224.1:42423)
I20260204 09:11:37.041016 10821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "410861e0f65b4777a1e91bc3129fe211" candidate_term: 12 candidate_status { last_received { term: 11 index: 23 } } ignore_live_leader: false dest_uuid: "569cc1b853df4850b68d0e630e2ccafa"
I20260204 09:11:37.041039 10787 leader_election.cc:304] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 569cc1b853df4850b68d0e630e2ccafa; no voters: 221661cb244d40738b986866c02b37fc, 410861e0f65b4777a1e91bc3129fe211
I20260204 09:11:37.041064 10821 raft_consensus.cc:2393] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 410861e0f65b4777a1e91bc3129fe211 in current term 12: Already voted for candidate 569cc1b853df4850b68d0e630e2ccafa in this term.
I20260204 09:11:37.041069 10745 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "410861e0f65b4777a1e91bc3129fe211" candidate_term: 12 candidate_status { last_received { term: 11 index: 23 } } ignore_live_leader: false dest_uuid: "221661cb244d40738b986866c02b37fc"
I20260204 09:11:37.041145 10953 raft_consensus.cc:2749] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260204 09:11:37.041226 10861 leader_election.cc:304] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 410861e0f65b4777a1e91bc3129fe211; no voters: 221661cb244d40738b986866c02b37fc, 569cc1b853df4850b68d0e630e2ccafa
I20260204 09:11:37.041311 10986 raft_consensus.cc:2749] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260204 09:11:37.049726 10896 raft_consensus.cc:1240] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 12 FOLLOWER]: Rejecting Update request from peer 221661cb244d40738b986866c02b37fc for earlier term 11. Current term is 12. Ops: []
I20260204 09:11:37.049916 10994 consensus_queue.cc:1059] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 }, Status: INVALID_TERM, Last received: 11.23, Next index: 24, Last known committed idx: 23, Time since last communication: 0.000s
W20260204 09:11:37.049965 10771 heartbeater.cc:646] Failed to heartbeat to 127.9.224.62:42277 (0 consecutive failures): Remote error: Failed to send heartbeat to master: Service unavailable: service kudu.master.MasterService not registered on Master
I20260204 09:11:37.050020 10994 raft_consensus.cc:3055] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 11 LEADER]: Stepping down as leader of term 11
I20260204 09:11:37.050055 10994 raft_consensus.cc:740] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 221661cb244d40738b986866c02b37fc, State: Running, Role: LEADER
I20260204 09:11:37.050115 10994 consensus_queue.cc:260] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 11.23, Last appended by leader: 23, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:37.050194 10994 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 11 FOLLOWER]: Advancing to term 12
I20260204 09:11:37.158154 10986 raft_consensus.cc:493] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:37.158254 10986 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 12 FOLLOWER]: Advancing to term 13
I20260204 09:11:37.159139 10986 raft_consensus.cc:515] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:37.159404 10986 leader_election.cc:290] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [CANDIDATE]: Term 13 election: Requested vote from peers 569cc1b853df4850b68d0e630e2ccafa (127.9.224.2:43003), 221661cb244d40738b986866c02b37fc (127.9.224.1:42423)
I20260204 09:11:37.159694 10745 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "410861e0f65b4777a1e91bc3129fe211" candidate_term: 13 candidate_status { last_received { term: 11 index: 23 } } ignore_live_leader: false dest_uuid: "221661cb244d40738b986866c02b37fc"
I20260204 09:11:37.159703 10821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7f9164e7670448282985c3ee263c176" candidate_uuid: "410861e0f65b4777a1e91bc3129fe211" candidate_term: 13 candidate_status { last_received { term: 11 index: 23 } } ignore_live_leader: false dest_uuid: "569cc1b853df4850b68d0e630e2ccafa"
I20260204 09:11:37.159787 10745 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 12 FOLLOWER]: Advancing to term 13
I20260204 09:11:37.159833 10821 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 12 FOLLOWER]: Advancing to term 13
I20260204 09:11:37.160509 10821 raft_consensus.cc:2468] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 410861e0f65b4777a1e91bc3129fe211 in term 13.
I20260204 09:11:37.160544 10745 raft_consensus.cc:2468] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 410861e0f65b4777a1e91bc3129fe211 in term 13.
I20260204 09:11:37.160693 10861 leader_election.cc:304] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221661cb244d40738b986866c02b37fc, 410861e0f65b4777a1e91bc3129fe211; no voters:
I20260204 09:11:37.160782 10986 raft_consensus.cc:2804] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 13 FOLLOWER]: Leader election won for term 13
I20260204 09:11:37.160830 10986 raft_consensus.cc:697] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 13 LEADER]: Becoming Leader. State: Replica: 410861e0f65b4777a1e91bc3129fe211, State: Running, Role: LEADER
I20260204 09:11:37.160876 10986 consensus_queue.cc:237] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 11.23, Last appended by leader: 23, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:37.210155 10112 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 541e2e06aa704740adb7e9d1c5272df8 [term 1 LEADER]: Raft consensus shutting down.
I20260204 09:11:37.210261 10112 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 541e2e06aa704740adb7e9d1c5272df8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 09:11:37.210281 10112 tablet_replica.cc:333] T 00000000000000000000000000000000 P 541e2e06aa704740adb7e9d1c5272df8: stopping tablet replica
I20260204 09:11:37.222126 10112 master.cc:583] Master@127.9.224.62:42277 shutdown complete.
I20260204 09:11:37.223316 10112 tablet_server.cc:178] TabletServer@127.9.224.1:0 shutting down...
I20260204 09:11:37.248652 10821 raft_consensus.cc:1275] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 13 FOLLOWER]: Refusing update from remote peer 410861e0f65b4777a1e91bc3129fe211: Log matching property violated. Preceding OpId in replica: term: 11 index: 23. Preceding OpId from leader: term: 13 index: 24. (index mismatch)
I20260204 09:11:37.248919 10986 consensus_queue.cc:1048] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [LEADER]: Connected to new peer: Peer: permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.000s
W20260204 09:11:37.250161 10861 consensus_peers.cc:597] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 -> Peer 221661cb244d40738b986866c02b37fc (127.9.224.1:42423): Couldn't send request to peer 221661cb244d40738b986866c02b37fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260204 09:11:37.274237 10112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260204 09:11:37.274349 10112 tablet_replica.cc:333] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc: stopping tablet replica
I20260204 09:11:37.274405 10112 raft_consensus.cc:2243] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 13 FOLLOWER]: Raft consensus shutting down.
I20260204 09:11:37.274456 10112 raft_consensus.cc:2272] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260204 09:11:37.286173 10112 tablet_server.cc:195] TabletServer@127.9.224.1:0 shutdown complete.
I20260204 09:11:37.287155 10112 tablet_server.cc:178] TabletServer@127.9.224.2:0 shutting down...
I20260204 09:11:37.318248 10112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260204 09:11:37.318399 10112 tablet_replica.cc:333] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa: stopping tablet replica
I20260204 09:11:37.318482 10112 raft_consensus.cc:2243] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 13 FOLLOWER]: Raft consensus shutting down.
I20260204 09:11:37.318528 10112 raft_consensus.cc:2272] T b7f9164e7670448282985c3ee263c176 P 569cc1b853df4850b68d0e630e2ccafa [term 13 FOLLOWER]: Raft consensus is shut down!
I20260204 09:11:37.330050 10112 tablet_server.cc:195] TabletServer@127.9.224.2:0 shutdown complete.
I20260204 09:11:37.330832 10112 tablet_server.cc:178] TabletServer@127.9.224.3:0 shutting down...
W20260204 09:11:37.342690 10861 consensus_peers.cc:597] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 -> Peer 569cc1b853df4850b68d0e630e2ccafa (127.9.224.2:43003): Couldn't send request to peer 569cc1b853df4850b68d0e630e2ccafa. Status: Network error: Client connection negotiation failed: client connection to 127.9.224.2:43003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260204 09:11:37.581915 10112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260204 09:11:37.582049 10112 tablet_replica.cc:333] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211: stopping tablet replica
I20260204 09:11:37.582105 10112 raft_consensus.cc:2243] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 13 LEADER]: Raft consensus shutting down.
I20260204 09:11:37.582185 10112 raft_consensus.cc:2272] T b7f9164e7670448282985c3ee263c176 P 410861e0f65b4777a1e91bc3129fe211 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260204 09:11:37.583891 10112 tablet_server.cc:195] TabletServer@127.9.224.3:0 shutdown complete.
I20260204 09:11:37.584659 10112 timestamp_advancement-itest.cc:282] Restarting single tablet server...
I20260204 09:11:37.584784 10112 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 09:11:37.585810 10999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 09:11:37.585816 11000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 09:11:37.585927 11002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 09:11:37.586158 10112 server_base.cc:1060] running on GCE node
I20260204 09:11:37.586239 10112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 09:11:37.586268 10112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 09:11:37.586290 10112 hybrid_clock.cc:648] HybridClock initialized: now 1770196297586291 us; error 0 us; skew 500 ppm
I20260204 09:11:37.586789 10112 webserver.cc:492] Webserver started at http://127.9.224.1:44497/ using document root <none> and password file <none>
I20260204 09:11:37.586859 10112 fs_manager.cc:362] Metadata directory not provided
I20260204 09:11:37.586891 10112 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260204 09:11:37.587500 10112 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:37.588734 11010 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:37.588845 10112 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260204 09:11:37.588891 10112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1770196261863819-10112-0/minicluster-data/ts-0-root
uuid: "221661cb244d40738b986866c02b37fc"
format_stamp: "Formatted at 2026-02-04 09:11:34 on dist-test-slave-4hq3"
I20260204 09:11:37.588940 10112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1770196261863819-10112-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1770196261863819-10112-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1770196261863819-10112-0/minicluster-data/ts-0-root/data
Total live blocks: 5
Total live bytes: 5432
Total live bytes (after alignment): 24576
Total number of LBM containers: 6 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 09:11:37.602214 10112 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 09:11:37.602376 10112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 09:11:37.602511 10112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260204 09:11:37.602769 11017 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260204 09:11:37.603397 10112 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260204 09:11:37.603434 10112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20260204 09:11:37.603466 10112 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260204 09:11:37.603863 10112 ts_tablet_manager.cc:616] Registered 1 tablets
I20260204 09:11:37.603889 10112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:37.603897 11017 tablet_bootstrap.cc:492] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc: Bootstrap starting.
I20260204 09:11:37.605216 11017 tablet_bootstrap.cc:492] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=2 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 09:11:37.605479 11017 tablet_bootstrap.cc:492] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc: Bootstrap complete.
I20260204 09:11:37.605581 11017 ts_tablet_manager.cc:1403] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260204 09:11:37.605701 11017 raft_consensus.cc:359] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 13 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:37.605767 11017 raft_consensus.cc:740] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 13 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221661cb244d40738b986866c02b37fc, State: Initialized, Role: FOLLOWER
I20260204 09:11:37.605813 11017 consensus_queue.cc:260] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 23, Last appended: 11.23, Last appended by leader: 23, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:37.605952 11017 ts_tablet_manager.cc:1434] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260204 09:11:37.606805 10112 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.1:42423
I20260204 09:11:37.609014 11076 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.224.1:42423 every 8 connection(s)
W20260204 09:11:37.609712 11077 heartbeater.cc:412] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260204 09:11:37.617241 10112 tablet_server.cc:178] TabletServer@127.9.224.1:42423 shutting down...
I20260204 09:11:37.685413 11058 raft_consensus.cc:493] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:37.685506 11058 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 13 FOLLOWER]: Advancing to term 14
I20260204 09:11:37.686216 11058 raft_consensus.cc:515] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:37.686442 11058 leader_election.cc:290] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [CANDIDATE]: Term 14 election: Requested vote from peers 569cc1b853df4850b68d0e630e2ccafa (127.9.224.2:43003), 410861e0f65b4777a1e91bc3129fe211 (127.9.224.3:46063)
W20260204 09:11:37.687076 11014 leader_election.cc:336] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 410861e0f65b4777a1e91bc3129fe211 (127.9.224.3:46063): Network error: Client connection negotiation failed: client connection to 127.9.224.3:46063: connect: Connection refused (error 111)
W20260204 09:11:37.687165 11013 leader_election.cc:336] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 569cc1b853df4850b68d0e630e2ccafa (127.9.224.2:43003): Network error: Client connection negotiation failed: client connection to 127.9.224.2:43003: connect: Connection refused (error 111)
I20260204 09:11:37.687223 11013 leader_election.cc:304] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 221661cb244d40738b986866c02b37fc; no voters: 410861e0f65b4777a1e91bc3129fe211, 569cc1b853df4850b68d0e630e2ccafa
I20260204 09:11:37.687301 11058 raft_consensus.cc:2749] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260204 09:11:37.797824 11058 raft_consensus.cc:493] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:37.797919 11058 raft_consensus.cc:3060] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 14 FOLLOWER]: Advancing to term 15
I20260204 09:11:37.798568 11058 raft_consensus.cc:515] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "569cc1b853df4850b68d0e630e2ccafa" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 43003 } } peers { permanent_uuid: "221661cb244d40738b986866c02b37fc" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 42423 } } peers { permanent_uuid: "410861e0f65b4777a1e91bc3129fe211" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 46063 } }
I20260204 09:11:37.798718 11058 leader_election.cc:290] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [CANDIDATE]: Term 15 election: Requested vote from peers 569cc1b853df4850b68d0e630e2ccafa (127.9.224.2:43003), 410861e0f65b4777a1e91bc3129fe211 (127.9.224.3:46063)
W20260204 09:11:37.799302 11013 leader_election.cc:336] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 569cc1b853df4850b68d0e630e2ccafa (127.9.224.2:43003): Network error: Client connection negotiation failed: client connection to 127.9.224.2:43003: connect: Connection refused (error 111)
W20260204 09:11:37.799392 11014 leader_election.cc:336] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 410861e0f65b4777a1e91bc3129fe211 (127.9.224.3:46063): Network error: Client connection negotiation failed: client connection to 127.9.224.3:46063: connect: Connection refused (error 111)
I20260204 09:11:37.799448 11014 leader_election.cc:304] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 221661cb244d40738b986866c02b37fc; no voters: 410861e0f65b4777a1e91bc3129fe211, 569cc1b853df4850b68d0e630e2ccafa
I20260204 09:11:37.799538 11058 raft_consensus.cc:2749] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260204 09:11:37.859390 10112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260204 09:11:37.859608 10112 tablet_replica.cc:333] stopping tablet replica
I20260204 09:11:37.859678 10112 raft_consensus.cc:2243] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 15 FOLLOWER]: Raft consensus shutting down.
I20260204 09:11:37.859735 10112 raft_consensus.cc:2272] T b7f9164e7670448282985c3ee263c176 P 221661cb244d40738b986866c02b37fc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260204 09:11:37.871330 10112 tablet_server.cc:195] TabletServer@127.9.224.1:42423 shutdown complete.
[ OK ] TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap (3452 ms)
[ RUN ] TimestampAdvancementITest.Kudu2463Test
I20260204 09:11:37.875423 10112 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.224.62:41859
I20260204 09:11:37.875581 10112 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 09:11:37.876626 11084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 09:11:37.876727 11085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 09:11:37.876633 11087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 09:11:37.876820 10112 server_base.cc:1060] running on GCE node
I20260204 09:11:37.876935 10112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 09:11:37.876959 10112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 09:11:37.876971 10112 hybrid_clock.cc:648] HybridClock initialized: now 1770196297876971 us; error 0 us; skew 500 ppm
I20260204 09:11:37.877463 10112 webserver.cc:492] Webserver started at http://127.9.224.62:35351/ using document root <none> and password file <none>
I20260204 09:11:37.877530 10112 fs_manager.cc:362] Metadata directory not provided
I20260204 09:11:37.877558 10112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 09:11:37.877591 10112 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 09:11:37.877797 10112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1770196261863819-10112-0/minicluster-data/master-0-root/instance:
uuid: "b376c39d64b6423181536142ceb472e3"
format_stamp: "Formatted at 2026-02-04 09:11:37 on dist-test-slave-4hq3"
I20260204 09:11:37.878504 10112 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260204 09:11:37.878934 11092 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:37.879070 10112 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:37.879117 10112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1770196261863819-10112-0/minicluster-data/master-0-root
uuid: "b376c39d64b6423181536142ceb472e3"
format_stamp: "Formatted at 2026-02-04 09:11:37 on dist-test-slave-4hq3"
I20260204 09:11:37.879154 10112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1770196261863819-10112-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1770196261863819-10112-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1770196261863819-10112-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 09:11:37.901958 10112 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 09:11:37.902136 10112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 09:11:37.904489 10112 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.62:41859
I20260204 09:11:37.905011 11144 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.224.62:41859 every 8 connection(s)
I20260204 09:11:37.905135 11145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 09:11:37.906222 11145 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b376c39d64b6423181536142ceb472e3: Bootstrap starting.
I20260204 09:11:37.906503 11145 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b376c39d64b6423181536142ceb472e3: Neither blocks nor log segments found. Creating new log.
I20260204 09:11:37.906956 11145 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b376c39d64b6423181536142ceb472e3: No bootstrap required, opened a new log
I20260204 09:11:37.907073 11145 raft_consensus.cc:359] T 00000000000000000000000000000000 P b376c39d64b6423181536142ceb472e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b376c39d64b6423181536142ceb472e3" member_type: VOTER }
I20260204 09:11:37.907121 11145 raft_consensus.cc:385] T 00000000000000000000000000000000 P b376c39d64b6423181536142ceb472e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 09:11:37.907140 11145 raft_consensus.cc:740] T 00000000000000000000000000000000 P b376c39d64b6423181536142ceb472e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b376c39d64b6423181536142ceb472e3, State: Initialized, Role: FOLLOWER
I20260204 09:11:37.907188 11145 consensus_queue.cc:260] T 00000000000000000000000000000000 P b376c39d64b6423181536142ceb472e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b376c39d64b6423181536142ceb472e3" member_type: VOTER }
I20260204 09:11:37.907224 11145 raft_consensus.cc:399] T 00000000000000000000000000000000 P b376c39d64b6423181536142ceb472e3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260204 09:11:37.907250 11145 raft_consensus.cc:493] T 00000000000000000000000000000000 P b376c39d64b6423181536142ceb472e3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260204 09:11:37.907276 11145 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b376c39d64b6423181536142ceb472e3 [term 0 FOLLOWER]: Advancing to term 1
I20260204 09:11:37.907732 11145 raft_consensus.cc:515] T 00000000000000000000000000000000 P b376c39d64b6423181536142ceb472e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b376c39d64b6423181536142ceb472e3" member_type: VOTER }
I20260204 09:11:37.907784 11145 leader_election.cc:304] T 00000000000000000000000000000000 P b376c39d64b6423181536142ceb472e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b376c39d64b6423181536142ceb472e3; no voters:
I20260204 09:11:37.907876 11145 leader_election.cc:290] T 00000000000000000000000000000000 P b376c39d64b6423181536142ceb472e3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260204 09:11:37.907944 11148 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b376c39d64b6423181536142ceb472e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 09:11:37.908006 11145 sys_catalog.cc:565] T 00000000000000000000000000000000 P b376c39d64b6423181536142ceb472e3 [sys.catalog]: configured and running, proceeding with master startup.
I20260204 09:11:37.908088 11148 raft_consensus.cc:697] T 00000000000000000000000000000000 P b376c39d64b6423181536142ceb472e3 [term 1 LEADER]: Becoming Leader. State: Replica: b376c39d64b6423181536142ceb472e3, State: Running, Role: LEADER
I20260204 09:11:37.908136 11148 consensus_queue.cc:237] T 00000000000000000000000000000000 P b376c39d64b6423181536142ceb472e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b376c39d64b6423181536142ceb472e3" member_type: VOTER }
I20260204 09:11:37.908373 11149 sys_catalog.cc:455] T 00000000000000000000000000000000 P b376c39d64b6423181536142ceb472e3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b376c39d64b6423181536142ceb472e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b376c39d64b6423181536142ceb472e3" member_type: VOTER } }
I20260204 09:11:37.908385 11150 sys_catalog.cc:455] T 00000000000000000000000000000000 P b376c39d64b6423181536142ceb472e3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b376c39d64b6423181536142ceb472e3. Latest consensus state: current_term: 1 leader_uuid: "b376c39d64b6423181536142ceb472e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b376c39d64b6423181536142ceb472e3" member_type: VOTER } }
I20260204 09:11:37.908447 11149 sys_catalog.cc:458] T 00000000000000000000000000000000 P b376c39d64b6423181536142ceb472e3 [sys.catalog]: This master's current role is: LEADER
I20260204 09:11:37.908591 11150 sys_catalog.cc:458] T 00000000000000000000000000000000 P b376c39d64b6423181536142ceb472e3 [sys.catalog]: This master's current role is: LEADER
I20260204 09:11:37.908705 11155 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260204 09:11:37.908849 11155 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260204 09:11:37.909250 10112 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260204 09:11:37.909400 11155 catalog_manager.cc:1357] Generated new cluster ID: 308be93853a541b398fe947793b0209c
I20260204 09:11:37.909444 11155 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260204 09:11:37.918756 11155 catalog_manager.cc:1380] Generated new certificate authority record
I20260204 09:11:37.919178 11155 catalog_manager.cc:1514] Loading token signing keys...
I20260204 09:11:37.922684 11155 catalog_manager.cc:6027] T 00000000000000000000000000000000 P b376c39d64b6423181536142ceb472e3: Generated new TSK 0
I20260204 09:11:37.922755 11155 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260204 09:11:37.924876 10112 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 09:11:37.925995 11166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 09:11:37.925992 11167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 09:11:37.926110 10112 server_base.cc:1060] running on GCE node
W20260204 09:11:37.926147 11169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 09:11:37.926280 10112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 09:11:37.926317 10112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 09:11:37.926329 10112 hybrid_clock.cc:648] HybridClock initialized: now 1770196297926329 us; error 0 us; skew 500 ppm
I20260204 09:11:37.926826 10112 webserver.cc:492] Webserver started at http://127.9.224.1:45983/ using document root <none> and password file <none>
I20260204 09:11:37.926898 10112 fs_manager.cc:362] Metadata directory not provided
I20260204 09:11:37.926931 10112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 09:11:37.926975 10112 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 09:11:37.927203 10112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1770196261863819-10112-0/minicluster-data/ts-0-root/instance:
uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae"
format_stamp: "Formatted at 2026-02-04 09:11:37 on dist-test-slave-4hq3"
I20260204 09:11:37.927948 10112 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260204 09:11:37.928303 11174 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:37.928426 10112 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:37.928470 10112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1770196261863819-10112-0/minicluster-data/ts-0-root
uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae"
format_stamp: "Formatted at 2026-02-04 09:11:37 on dist-test-slave-4hq3"
I20260204 09:11:37.928506 10112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1770196261863819-10112-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1770196261863819-10112-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1770196261863819-10112-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 09:11:37.934193 10112 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 09:11:37.934355 10112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 09:11:37.934468 10112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260204 09:11:37.934612 10112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260204 09:11:37.934634 10112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:37.934657 10112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260204 09:11:37.934674 10112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:37.937162 10112 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.1:34311
I20260204 09:11:37.937214 11237 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.224.1:34311 every 8 connection(s)
I20260204 09:11:37.937515 10112 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 09:11:37.938426 11243 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 09:11:37.938537 11242 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 09:11:37.938611 11245 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 09:11:37.938827 10112 server_base.cc:1060] running on GCE node
I20260204 09:11:37.938938 10112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 09:11:37.938967 10112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 09:11:37.938984 10112 hybrid_clock.cc:648] HybridClock initialized: now 1770196297938984 us; error 0 us; skew 500 ppm
I20260204 09:11:37.939512 10112 webserver.cc:492] Webserver started at http://127.9.224.2:40949/ using document root <none> and password file <none>
I20260204 09:11:37.939589 10112 fs_manager.cc:362] Metadata directory not provided
I20260204 09:11:37.939630 10112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 09:11:37.939671 10112 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 09:11:37.939949 10112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1770196261863819-10112-0/minicluster-data/ts-1-root/instance:
uuid: "089ac33f27a3476d87b25272430cba26"
format_stamp: "Formatted at 2026-02-04 09:11:37 on dist-test-slave-4hq3"
I20260204 09:11:37.940850 11238 heartbeater.cc:344] Connected to a master server at 127.9.224.62:41859
I20260204 09:11:37.940909 11238 heartbeater.cc:461] Registering TS with master...
I20260204 09:11:37.940907 10112 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260204 09:11:37.941028 11238 heartbeater.cc:507] Master 127.9.224.62:41859 requested a full tablet report, sending...
I20260204 09:11:37.941246 11109 ts_manager.cc:194] Registered new tserver with Master: d6a93f0e7e1e445ba8ac26f1ba48f1ae (127.9.224.1:34311)
I20260204 09:11:37.941431 11250 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:37.941567 10112 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:37.941610 10112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1770196261863819-10112-0/minicluster-data/ts-1-root
uuid: "089ac33f27a3476d87b25272430cba26"
format_stamp: "Formatted at 2026-02-04 09:11:37 on dist-test-slave-4hq3"
I20260204 09:11:37.941658 10112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1770196261863819-10112-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1770196261863819-10112-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1770196261863819-10112-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 09:11:37.941926 11109 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52198
I20260204 09:11:37.958246 10112 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 09:11:37.958454 10112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 09:11:37.958601 10112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260204 09:11:37.958801 10112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260204 09:11:37.958828 10112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:37.958850 10112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260204 09:11:37.958874 10112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:37.961859 10112 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.2:35759
I20260204 09:11:37.961895 11313 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.224.2:35759 every 8 connection(s)
I20260204 09:11:37.962200 10112 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 09:11:37.963240 11317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 09:11:37.963336 11318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 09:11:37.963544 11320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 09:11:37.963595 10112 server_base.cc:1060] running on GCE node
I20260204 09:11:37.963754 10112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 09:11:37.963783 10112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 09:11:37.963799 10112 hybrid_clock.cc:648] HybridClock initialized: now 1770196297963799 us; error 0 us; skew 500 ppm
I20260204 09:11:37.964326 10112 webserver.cc:492] Webserver started at http://127.9.224.3:36557/ using document root <none> and password file <none>
I20260204 09:11:37.964411 10112 fs_manager.cc:362] Metadata directory not provided
I20260204 09:11:37.964457 10112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 09:11:37.964514 10112 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 09:11:37.964804 10112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1770196261863819-10112-0/minicluster-data/ts-2-root/instance:
uuid: "0350731cd29d4bdaa802b6131c95d68e"
format_stamp: "Formatted at 2026-02-04 09:11:37 on dist-test-slave-4hq3"
I20260204 09:11:37.964977 11314 heartbeater.cc:344] Connected to a master server at 127.9.224.62:41859
I20260204 09:11:37.965036 11314 heartbeater.cc:461] Registering TS with master...
I20260204 09:11:37.965131 11314 heartbeater.cc:507] Master 127.9.224.62:41859 requested a full tablet report, sending...
I20260204 09:11:37.965339 11109 ts_manager.cc:194] Registered new tserver with Master: 089ac33f27a3476d87b25272430cba26 (127.9.224.2:35759)
I20260204 09:11:37.965749 11109 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52206
I20260204 09:11:37.965799 10112 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260204 09:11:37.966245 11325 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:37.966353 10112 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:37.966392 10112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1770196261863819-10112-0/minicluster-data/ts-2-root
uuid: "0350731cd29d4bdaa802b6131c95d68e"
format_stamp: "Formatted at 2026-02-04 09:11:37 on dist-test-slave-4hq3"
I20260204 09:11:37.966435 10112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1770196261863819-10112-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1770196261863819-10112-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1770196261863819-10112-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 09:11:37.994414 10112 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 09:11:37.994683 10112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 09:11:37.994853 10112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260204 09:11:37.995038 10112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260204 09:11:37.995064 10112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:37.995093 10112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260204 09:11:37.995117 10112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:37.998236 10112 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.3:43961
I20260204 09:11:37.998306 11388 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.224.3:43961 every 8 connection(s)
I20260204 09:11:38.000967 11389 heartbeater.cc:344] Connected to a master server at 127.9.224.62:41859
I20260204 09:11:38.001021 11389 heartbeater.cc:461] Registering TS with master...
I20260204 09:11:38.001116 11389 heartbeater.cc:507] Master 127.9.224.62:41859 requested a full tablet report, sending...
I20260204 09:11:38.001314 11109 ts_manager.cc:194] Registered new tserver with Master: 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3:43961)
I20260204 09:11:38.001652 11109 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52218
I20260204 09:11:38.001703 10112 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003304869s
I20260204 09:11:38.012084 11109 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52252:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260204 09:11:38.012233 11109 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260204 09:11:38.016525 11202 tablet_service.cc:1505] Processing CreateTablet for tablet 32ad7b3e12874e8eb2604956e74c7ca5 (DEFAULT_TABLE table=test-workload [id=0a82e8d2254149e0b61004b09a9632fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260204 09:11:38.016692 11202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32ad7b3e12874e8eb2604956e74c7ca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 09:11:38.016876 11278 tablet_service.cc:1505] Processing CreateTablet for tablet 32ad7b3e12874e8eb2604956e74c7ca5 (DEFAULT_TABLE table=test-workload [id=0a82e8d2254149e0b61004b09a9632fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260204 09:11:38.016958 11278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32ad7b3e12874e8eb2604956e74c7ca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 09:11:38.018172 11410 tablet_bootstrap.cc:492] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26: Bootstrap starting.
I20260204 09:11:38.018589 11410 tablet_bootstrap.cc:654] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26: Neither blocks nor log segments found. Creating new log.
I20260204 09:11:38.018715 11353 tablet_service.cc:1505] Processing CreateTablet for tablet 32ad7b3e12874e8eb2604956e74c7ca5 (DEFAULT_TABLE table=test-workload [id=0a82e8d2254149e0b61004b09a9632fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260204 09:11:38.018810 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32ad7b3e12874e8eb2604956e74c7ca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 09:11:38.018915 11411 tablet_bootstrap.cc:492] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae: Bootstrap starting.
I20260204 09:11:38.019073 11410 tablet_bootstrap.cc:492] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26: No bootstrap required, opened a new log
I20260204 09:11:38.019120 11410 ts_tablet_manager.cc:1403] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260204 09:11:38.019286 11410 raft_consensus.cc:359] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } }
I20260204 09:11:38.019357 11410 raft_consensus.cc:385] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 09:11:38.019376 11410 raft_consensus.cc:740] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 089ac33f27a3476d87b25272430cba26, State: Initialized, Role: FOLLOWER
I20260204 09:11:38.019403 11411 tablet_bootstrap.cc:654] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae: Neither blocks nor log segments found. Creating new log.
I20260204 09:11:38.019436 11410 consensus_queue.cc:260] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } }
I20260204 09:11:38.019622 11410 ts_tablet_manager.cc:1434] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260204 09:11:38.019654 11314 heartbeater.cc:499] Master 127.9.224.62:41859 was elected leader, sending a full tablet report...
I20260204 09:11:38.019932 11411 tablet_bootstrap.cc:492] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae: No bootstrap required, opened a new log
I20260204 09:11:38.019973 11411 ts_tablet_manager.cc:1403] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260204 09:11:38.020107 11411 raft_consensus.cc:359] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } }
I20260204 09:11:38.020183 11411 raft_consensus.cc:385] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 09:11:38.020205 11411 raft_consensus.cc:740] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6a93f0e7e1e445ba8ac26f1ba48f1ae, State: Initialized, Role: FOLLOWER
I20260204 09:11:38.020247 11411 consensus_queue.cc:260] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } }
I20260204 09:11:38.020110 11415 tablet_bootstrap.cc:492] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e: Bootstrap starting.
I20260204 09:11:38.020390 11411 ts_tablet_manager.cc:1434] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260204 09:11:38.020467 11238 heartbeater.cc:499] Master 127.9.224.62:41859 was elected leader, sending a full tablet report...
I20260204 09:11:38.020777 11415 tablet_bootstrap.cc:654] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e: Neither blocks nor log segments found. Creating new log.
I20260204 09:11:38.021245 11415 tablet_bootstrap.cc:492] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e: No bootstrap required, opened a new log
I20260204 09:11:38.021282 11415 ts_tablet_manager.cc:1403] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260204 09:11:38.021418 11415 raft_consensus.cc:359] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } }
I20260204 09:11:38.021481 11415 raft_consensus.cc:385] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 09:11:38.021499 11415 raft_consensus.cc:740] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0350731cd29d4bdaa802b6131c95d68e, State: Initialized, Role: FOLLOWER
I20260204 09:11:38.021536 11415 consensus_queue.cc:260] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } }
I20260204 09:11:38.021674 11415 ts_tablet_manager.cc:1434] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260204 09:11:38.021723 11389 heartbeater.cc:499] Master 127.9.224.62:41859 was elected leader, sending a full tablet report...
I20260204 09:11:38.061697 11413 raft_consensus.cc:493] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260204 09:11:38.061797 11413 raft_consensus.cc:515] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } }
I20260204 09:11:38.062000 11413 leader_election.cc:290] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3:43961), d6a93f0e7e1e445ba8ac26f1ba48f1ae (127.9.224.1:34311)
I20260204 09:11:38.065078 11363 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "32ad7b3e12874e8eb2604956e74c7ca5" candidate_uuid: "089ac33f27a3476d87b25272430cba26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0350731cd29d4bdaa802b6131c95d68e" is_pre_election: true
I20260204 09:11:38.065078 11212 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "32ad7b3e12874e8eb2604956e74c7ca5" candidate_uuid: "089ac33f27a3476d87b25272430cba26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" is_pre_election: true
I20260204 09:11:38.065215 11363 raft_consensus.cc:2468] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 089ac33f27a3476d87b25272430cba26 in term 0.
I20260204 09:11:38.065229 11212 raft_consensus.cc:2468] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 089ac33f27a3476d87b25272430cba26 in term 0.
I20260204 09:11:38.065398 11251 leader_election.cc:304] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 089ac33f27a3476d87b25272430cba26, d6a93f0e7e1e445ba8ac26f1ba48f1ae; no voters:
I20260204 09:11:38.065500 11413 raft_consensus.cc:2804] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260204 09:11:38.065568 11413 raft_consensus.cc:493] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260204 09:11:38.065591 11413 raft_consensus.cc:3060] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [term 0 FOLLOWER]: Advancing to term 1
I20260204 09:11:38.066223 11413 raft_consensus.cc:515] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } }
I20260204 09:11:38.066367 11413 leader_election.cc:290] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [CANDIDATE]: Term 1 election: Requested vote from peers 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3:43961), d6a93f0e7e1e445ba8ac26f1ba48f1ae (127.9.224.1:34311)
I20260204 09:11:38.066502 11363 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "32ad7b3e12874e8eb2604956e74c7ca5" candidate_uuid: "089ac33f27a3476d87b25272430cba26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0350731cd29d4bdaa802b6131c95d68e"
I20260204 09:11:38.066521 11212 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "32ad7b3e12874e8eb2604956e74c7ca5" candidate_uuid: "089ac33f27a3476d87b25272430cba26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae"
I20260204 09:11:38.066560 11363 raft_consensus.cc:3060] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 0 FOLLOWER]: Advancing to term 1
I20260204 09:11:38.066571 11212 raft_consensus.cc:3060] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 0 FOLLOWER]: Advancing to term 1
I20260204 09:11:38.067199 11212 raft_consensus.cc:2468] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 089ac33f27a3476d87b25272430cba26 in term 1.
I20260204 09:11:38.067227 11363 raft_consensus.cc:2468] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 089ac33f27a3476d87b25272430cba26 in term 1.
I20260204 09:11:38.067349 11251 leader_election.cc:304] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 089ac33f27a3476d87b25272430cba26, d6a93f0e7e1e445ba8ac26f1ba48f1ae; no voters:
I20260204 09:11:38.067440 11413 raft_consensus.cc:2804] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 09:11:38.067587 11413 raft_consensus.cc:697] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [term 1 LEADER]: Becoming Leader. State: Replica: 089ac33f27a3476d87b25272430cba26, State: Running, Role: LEADER
I20260204 09:11:38.067638 11413 consensus_queue.cc:237] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } }
I20260204 09:11:38.068173 11108 catalog_manager.cc:5654] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 reported cstate change: term changed from 0 to 1, leader changed from <none> to 089ac33f27a3476d87b25272430cba26 (127.9.224.2). New cstate: current_term: 1 leader_uuid: "089ac33f27a3476d87b25272430cba26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } health_report { overall_health: UNKNOWN } } }
I20260204 09:11:38.075937 11212 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 09:11:38.075937 11363 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 FOLLOWER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260204 09:11:38.076172 11428 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 09:11:38.076277 11420 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260204 09:11:38.093716 11288 consensus_queue.cc:237] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 1.18, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } }
I20260204 09:11:38.094086 11363 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 FOLLOWER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 18. Preceding OpId from leader: term: 1 index: 19. (index mismatch)
I20260204 09:11:38.094086 11212 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 18. Preceding OpId from leader: term: 1 index: 19. (index mismatch)
I20260204 09:11:38.094273 11420 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260204 09:11:38.094360 11413 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260204 09:11:38.094871 11428 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [term 1 LEADER]: Committing config change with OpId 1.19: config changed from index -1 to 19, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.094951 11363 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 LEARNER]: Committing config change with OpId 1.19: config changed from index -1 to 19, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.095752 11212 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Committing config change with OpId 1.19: config changed from index -1 to 19, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.095880 11108 catalog_manager.cc:5654] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e reported cstate change: config changed from index -1 to 19, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "089ac33f27a3476d87b25272430cba26" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
W20260204 09:11:38.096663 11107 catalog_manager.cc:5332] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 32ad7b3e12874e8eb2604956e74c7ca5 with cas_config_opid_index 19: no extra replica candidate found for tablet 32ad7b3e12874e8eb2604956e74c7ca5 (table test-workload [id=0a82e8d2254149e0b61004b09a9632fd]): Not found: could not select location for extra replica: not enough tablet servers to satisfy replica placement policy: the total number of registered tablet servers (3) does not allow for adding an extra replica; consider bringing up more to have at least 4 tablet servers up and running
I20260204 09:11:38.096704 11288 consensus_queue.cc:237] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 1.19, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } }
I20260204 09:11:38.097003 11212 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 19. Preceding OpId from leader: term: 1 index: 20. (index mismatch)
I20260204 09:11:38.097045 11363 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 LEARNER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 19. Preceding OpId from leader: term: 1 index: 20. (index mismatch)
I20260204 09:11:38.097159 11428 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260204 09:11:38.097242 11413 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260204 09:11:38.097756 11413 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [term 1 LEADER]: Committing config change with OpId 1.20: config changed from index 19 to 20, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.097873 11212 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Committing config change with OpId 1.20: config changed from index 19 to 20, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.097895 11363 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 FOLLOWER]: Committing config change with OpId 1.20: config changed from index 19 to 20, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.098609 11107 catalog_manager.cc:5654] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 reported cstate change: config changed from index 19 to 20, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "089ac33f27a3476d87b25272430cba26" committed_config { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:38.098693 11288 consensus_queue.cc:237] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 1.20, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } }
I20260204 09:11:38.098984 11363 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 FOLLOWER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 20. Preceding OpId from leader: term: 1 index: 21. (index mismatch)
I20260204 09:11:38.098994 11212 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 20. Preceding OpId from leader: term: 1 index: 21. (index mismatch)
I20260204 09:11:38.099138 11420 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260204 09:11:38.099221 11428 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260204 09:11:38.099735 11428 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [term 1 LEADER]: Committing config change with OpId 1.21: config changed from index 20 to 21, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New config: { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.099896 11212 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Committing config change with OpId 1.21: config changed from index 20 to 21, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New config: { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.100550 11363 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 LEARNER]: Committing config change with OpId 1.21: config changed from index 20 to 21, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New config: { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.100605 11108 catalog_manager.cc:5654] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 reported cstate change: config changed from index 20 to 21, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "089ac33f27a3476d87b25272430cba26" committed_config { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:38.100716 11288 consensus_queue.cc:237] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 1.21, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } }
I20260204 09:11:38.101069 11212 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 21. Preceding OpId from leader: term: 1 index: 22. (index mismatch)
I20260204 09:11:38.101287 11362 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 LEARNER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 21. Preceding OpId from leader: term: 1 index: 22. (index mismatch)
I20260204 09:11:38.101404 11413 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260204 09:11:38.101615 11413 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260204 09:11:38.102012 11420 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [term 1 LEADER]: Committing config change with OpId 1.22: config changed from index 21 to 22, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New config: { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.102130 11212 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Committing config change with OpId 1.22: config changed from index 21 to 22, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New config: { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.102187 11362 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 FOLLOWER]: Committing config change with OpId 1.22: config changed from index 21 to 22, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New config: { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.102968 11109 catalog_manager.cc:5654] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 reported cstate change: config changed from index 21 to 22, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "089ac33f27a3476d87b25272430cba26" committed_config { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:38.103431 11288 consensus_queue.cc:237] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 1.22, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } }
I20260204 09:11:38.103749 11362 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 FOLLOWER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 22. Preceding OpId from leader: term: 1 index: 23. (index mismatch)
I20260204 09:11:38.103823 11212 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 22. Preceding OpId from leader: term: 1 index: 23. (index mismatch)
I20260204 09:11:38.103894 11428 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
I20260204 09:11:38.103986 11428 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
I20260204 09:11:38.104429 11420 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [term 1 LEADER]: Committing config change with OpId 1.23: config changed from index 22 to 23, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New config: { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.104573 11212 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Committing config change with OpId 1.23: config changed from index 22 to 23, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New config: { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.105247 11362 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 LEARNER]: Committing config change with OpId 1.23: config changed from index 22 to 23, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New config: { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.105259 11107 catalog_manager.cc:5654] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 reported cstate change: config changed from index 22 to 23, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "089ac33f27a3476d87b25272430cba26" committed_config { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:38.105787 11288 consensus_queue.cc:237] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 1.23, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } }
I20260204 09:11:38.106271 11362 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 LEARNER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 23. Preceding OpId from leader: term: 1 index: 24. (index mismatch)
I20260204 09:11:38.106287 11212 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 23. Preceding OpId from leader: term: 1 index: 24. (index mismatch)
I20260204 09:11:38.106429 11428 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.000s
I20260204 09:11:38.106545 11413 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.000s
I20260204 09:11:38.106942 11428 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [term 1 LEADER]: Committing config change with OpId 1.24: config changed from index 23 to 24, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New config: { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.107059 11362 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 FOLLOWER]: Committing config change with OpId 1.24: config changed from index 23 to 24, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New config: { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.107124 11212 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Committing config change with OpId 1.24: config changed from index 23 to 24, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New config: { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.107793 11108 catalog_manager.cc:5654] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 reported cstate change: config changed from index 23 to 24, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "089ac33f27a3476d87b25272430cba26" committed_config { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:38.108024 11288 consensus_queue.cc:237] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 1.24, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } }
I20260204 09:11:38.108407 11362 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 FOLLOWER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 24. Preceding OpId from leader: term: 1 index: 25. (index mismatch)
I20260204 09:11:38.108572 11212 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 24. Preceding OpId from leader: term: 1 index: 25. (index mismatch)
I20260204 09:11:38.108570 11428 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.000s
I20260204 09:11:38.108806 11428 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.000s
I20260204 09:11:38.109282 11413 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [term 1 LEADER]: Committing config change with OpId 1.25: config changed from index 24 to 25, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.109383 11212 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Committing config change with OpId 1.25: config changed from index 24 to 25, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.110121 11107 catalog_manager.cc:5654] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 reported cstate change: config changed from index 24 to 25, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "089ac33f27a3476d87b25272430cba26" committed_config { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:38.110208 11362 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 LEARNER]: Committing config change with OpId 1.25: config changed from index 24 to 25, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.110214 11288 consensus_queue.cc:237] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 1.25, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } }
I20260204 09:11:38.110728 11212 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 1 index: 26. (index mismatch)
I20260204 09:11:38.110853 11413 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20260204 09:11:38.111124 11363 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 LEARNER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 1 index: 26. (index mismatch)
I20260204 09:11:38.111274 11413 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20260204 09:11:38.111383 11428 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [term 1 LEADER]: Committing config change with OpId 1.26: config changed from index 25 to 26, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.111479 11212 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Committing config change with OpId 1.26: config changed from index 25 to 26, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.111984 11363 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 FOLLOWER]: Committing config change with OpId 1.26: config changed from index 25 to 26, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.112255 11288 consensus_queue.cc:237] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 1.26, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } }
I20260204 09:11:38.112327 11109 catalog_manager.cc:5654] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 reported cstate change: config changed from index 25 to 26, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "089ac33f27a3476d87b25272430cba26" committed_config { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:38.112583 11212 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20260204 09:11:38.112702 11413 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20260204 09:11:38.112980 11362 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 FOLLOWER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20260204 09:11:38.113124 11413 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20260204 09:11:38.113499 11420 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [term 1 LEADER]: Committing config change with OpId 1.27: config changed from index 26 to 27, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.113689 11362 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 LEARNER]: Committing config change with OpId 1.27: config changed from index 26 to 27, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.114270 11212 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Committing config change with OpId 1.27: config changed from index 26 to 27, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.114291 11109 catalog_manager.cc:5654] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 reported cstate change: config changed from index 26 to 27, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "089ac33f27a3476d87b25272430cba26" committed_config { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:38.114588 11288 consensus_queue.cc:237] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 1.27, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } }
I20260204 09:11:38.114912 11362 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 LEARNER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20260204 09:11:38.115041 11420 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20260204 09:11:38.115303 11212 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20260204 09:11:38.115486 11428 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20260204 09:11:38.115609 11428 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [term 1 LEADER]: Committing config change with OpId 1.28: config changed from index 27 to 28, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.115734 11362 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index 27 to 28, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.116041 11212 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index 27 to 28, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.116465 11109 catalog_manager.cc:5654] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e reported cstate change: config changed from index 27 to 28, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "089ac33f27a3476d87b25272430cba26" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.116670 11288 consensus_queue.cc:237] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 1.28, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } }
I20260204 09:11:38.116997 11362 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 FOLLOWER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 1 index: 29. (index mismatch)
I20260204 09:11:38.117122 11428 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20260204 09:11:38.117110 11212 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 1 index: 29. (index mismatch)
I20260204 09:11:38.117347 11413 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20260204 09:11:38.117851 11428 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [term 1 LEADER]: Committing config change with OpId 1.29: config changed from index 28 to 29, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.118000 11212 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Committing config change with OpId 1.29: config changed from index 28 to 29, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.118505 11362 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 LEARNER]: Committing config change with OpId 1.29: config changed from index 28 to 29, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.118516 11107 catalog_manager.cc:5654] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 reported cstate change: config changed from index 28 to 29, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "089ac33f27a3476d87b25272430cba26" committed_config { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:38.119383 11288 consensus_queue.cc:237] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 1.29, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } }
I20260204 09:11:38.119689 11362 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 LEARNER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 29. Preceding OpId from leader: term: 1 index: 30. (index mismatch)
I20260204 09:11:38.119921 11212 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 29. Preceding OpId from leader: term: 1 index: 30. (index mismatch)
I20260204 09:11:38.119899 11445 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20260204 09:11:38.120225 11445 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20260204 09:11:38.120383 11413 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [term 1 LEADER]: Committing config change with OpId 1.30: config changed from index 29 to 30, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.120472 11362 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 FOLLOWER]: Committing config change with OpId 1.30: config changed from index 29 to 30, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.120893 11212 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Committing config change with OpId 1.30: config changed from index 29 to 30, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.121251 11108 catalog_manager.cc:5654] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 reported cstate change: config changed from index 29 to 30, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "089ac33f27a3476d87b25272430cba26" committed_config { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:38.121544 11288 consensus_queue.cc:237] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 1.30, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } }
I20260204 09:11:38.121868 11211 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 30. Preceding OpId from leader: term: 1 index: 31. (index mismatch)
I20260204 09:11:38.122005 11362 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 FOLLOWER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 30. Preceding OpId from leader: term: 1 index: 31. (index mismatch)
I20260204 09:11:38.122068 11446 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20260204 09:11:38.122152 11428 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20260204 09:11:38.122611 11413 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [term 1 LEADER]: Committing config change with OpId 1.31: config changed from index 30 to 31, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.122709 11212 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Committing config change with OpId 1.31: config changed from index 30 to 31, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.123407 11362 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 LEARNER]: Committing config change with OpId 1.31: config changed from index 30 to 31, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.123440 11107 catalog_manager.cc:5654] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 reported cstate change: config changed from index 30 to 31, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "089ac33f27a3476d87b25272430cba26" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:38.123587 11288 consensus_queue.cc:237] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 1.31, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } }
I20260204 09:11:38.124122 11363 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 LEARNER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 31. Preceding OpId from leader: term: 1 index: 32. (index mismatch)
I20260204 09:11:38.124105 11212 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 31. Preceding OpId from leader: term: 1 index: 32. (index mismatch)
I20260204 09:11:38.124285 11446 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20260204 09:11:38.124387 11428 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20260204 09:11:38.124873 11420 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [term 1 LEADER]: Committing config change with OpId 1.32: config changed from index 31 to 32, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.124961 11363 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 FOLLOWER]: Committing config change with OpId 1.32: config changed from index 31 to 32, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.125682 11212 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Committing config change with OpId 1.32: config changed from index 31 to 32, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.125717 11288 consensus_queue.cc:237] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 32, Committed index: 32, Last appended: 1.32, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } }
I20260204 09:11:38.125816 11107 catalog_manager.cc:5654] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e reported cstate change: config changed from index 31 to 32, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "089ac33f27a3476d87b25272430cba26" committed_config { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.126220 11363 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 FOLLOWER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 32. Preceding OpId from leader: term: 1 index: 33. (index mismatch)
I20260204 09:11:38.126397 11445 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20260204 09:11:38.126485 11211 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 32. Preceding OpId from leader: term: 1 index: 33. (index mismatch)
I20260204 09:11:38.126832 11445 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20260204 09:11:38.127286 11445 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [term 1 LEADER]: Committing config change with OpId 1.33: config changed from index 32 to 33, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.127411 11211 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Committing config change with OpId 1.33: config changed from index 32 to 33, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.128155 11108 catalog_manager.cc:5654] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 reported cstate change: config changed from index 32 to 33, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "089ac33f27a3476d87b25272430cba26" committed_config { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:38.128286 11288 consensus_queue.cc:237] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 33, Committed index: 33, Last appended: 1.33, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } }
I20260204 09:11:38.128156 11363 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 LEARNER]: Committing config change with OpId 1.33: config changed from index 32 to 33, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.128839 11211 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 33. Preceding OpId from leader: term: 1 index: 34. (index mismatch)
I20260204 09:11:38.128960 11362 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 LEARNER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 33. Preceding OpId from leader: term: 1 index: 34. (index mismatch)
I20260204 09:11:38.128969 11446 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20260204 09:11:38.129119 11446 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20260204 09:11:38.129534 11211 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Committing config change with OpId 1.34: config changed from index 33 to 34, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.129606 11446 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [term 1 LEADER]: Committing config change with OpId 1.34: config changed from index 33 to 34, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.129891 11363 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 FOLLOWER]: Committing config change with OpId 1.34: config changed from index 33 to 34, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.130381 11108 catalog_manager.cc:5654] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 reported cstate change: config changed from index 33 to 34, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "089ac33f27a3476d87b25272430cba26" committed_config { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:38.130582 11288 consensus_queue.cc:237] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 34, Committed index: 34, Last appended: 1.34, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } }
I20260204 09:11:38.130904 11363 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 FOLLOWER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 34. Preceding OpId from leader: term: 1 index: 35. (index mismatch)
I20260204 09:11:38.131089 11446 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 35, Last known committed idx: 34, Time since last communication: 0.000s
I20260204 09:11:38.131265 11211 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 34. Preceding OpId from leader: term: 1 index: 35. (index mismatch)
I20260204 09:11:38.131404 11446 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 35, Last known committed idx: 34, Time since last communication: 0.000s
I20260204 09:11:38.131839 11445 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [term 1 LEADER]: Committing config change with OpId 1.35: config changed from index 34 to 35, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.131966 11211 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Committing config change with OpId 1.35: config changed from index 34 to 35, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.132707 11109 catalog_manager.cc:5654] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae reported cstate change: config changed from index 34 to 35, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "089ac33f27a3476d87b25272430cba26" committed_config { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.132841 11288 consensus_queue.cc:237] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 35, Committed index: 35, Last appended: 1.35, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } }
I20260204 09:11:38.132937 11363 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 LEARNER]: Committing config change with OpId 1.35: config changed from index 34 to 35, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.133162 11211 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 35. Preceding OpId from leader: term: 1 index: 36. (index mismatch)
I20260204 09:11:38.133334 11445 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 36, Last known committed idx: 35, Time since last communication: 0.000s
I20260204 09:11:38.133709 11362 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 LEARNER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 35. Preceding OpId from leader: term: 1 index: 36. (index mismatch)
I20260204 09:11:38.133944 11445 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 36, Last known committed idx: 35, Time since last communication: 0.000s
I20260204 09:11:38.134127 11446 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [term 1 LEADER]: Committing config change with OpId 1.36: config changed from index 35 to 36, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New config: { opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.134239 11211 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Committing config change with OpId 1.36: config changed from index 35 to 36, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New config: { opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.134506 11363 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 FOLLOWER]: Committing config change with OpId 1.36: config changed from index 35 to 36, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New config: { opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.134995 11107 catalog_manager.cc:5654] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 reported cstate change: config changed from index 35 to 36, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "089ac33f27a3476d87b25272430cba26" committed_config { opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:38.135457 11288 consensus_queue.cc:237] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 36, Committed index: 36, Last appended: 1.36, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 37 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } }
I20260204 09:11:38.135753 11363 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 FOLLOWER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 36. Preceding OpId from leader: term: 1 index: 37. (index mismatch)
I20260204 09:11:38.135893 11211 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 36. Preceding OpId from leader: term: 1 index: 37. (index mismatch)
I20260204 09:11:38.135998 11420 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 37, Last known committed idx: 36, Time since last communication: 0.000s
I20260204 09:11:38.136150 11420 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 37, Last known committed idx: 36, Time since last communication: 0.000s
I20260204 09:11:38.136597 11445 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [term 1 LEADER]: Committing config change with OpId 1.37: config changed from index 36 to 37, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New config: { opid_index: 37 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.136690 11211 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Committing config change with OpId 1.37: config changed from index 36 to 37, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New config: { opid_index: 37 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.137450 11108 catalog_manager.cc:5654] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae reported cstate change: config changed from index 36 to 37, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "089ac33f27a3476d87b25272430cba26" committed_config { opid_index: 37 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.137482 11363 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 LEARNER]: Committing config change with OpId 1.37: config changed from index 36 to 37, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from VOTER to NON_VOTER. New config: { opid_index: 37 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: NON_VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.137653 11288 consensus_queue.cc:237] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 37, Committed index: 37, Last appended: 1.37, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 38 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } }
I20260204 09:11:38.138211 11362 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 LEARNER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 37. Preceding OpId from leader: term: 1 index: 38. (index mismatch)
I20260204 09:11:38.138228 11211 raft_consensus.cc:1275] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Refusing update from remote peer 089ac33f27a3476d87b25272430cba26: Log matching property violated. Preceding OpId in replica: term: 1 index: 37. Preceding OpId from leader: term: 1 index: 38. (index mismatch)
I20260204 09:11:38.138365 11446 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 38, Last known committed idx: 37, Time since last communication: 0.000s
I20260204 09:11:38.138500 11446 consensus_queue.cc:1048] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 38, Last known committed idx: 37, Time since last communication: 0.000s
I20260204 09:11:38.138764 11095 catalog_manager.cc:5201] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 32ad7b3e12874e8eb2604956e74c7ca5 with cas_config_opid_index 21: aborting the task: latest config opid_index 37; task opid_index 21
I20260204 09:11:38.138983 11428 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [term 1 LEADER]: Committing config change with OpId 1.38: config changed from index 37 to 38, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New config: { opid_index: 38 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.139076 11211 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Committing config change with OpId 1.38: config changed from index 37 to 38, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New config: { opid_index: 38 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.139087 11363 raft_consensus.cc:2955] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 FOLLOWER]: Committing config change with OpId 1.38: config changed from index 37 to 38, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New config: { opid_index: 38 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } } }
I20260204 09:11:38.139684 11109 catalog_manager.cc:5654] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 reported cstate change: config changed from index 37 to 38, 0350731cd29d4bdaa802b6131c95d68e (127.9.224.3) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "089ac33f27a3476d87b25272430cba26" committed_config { opid_index: 38 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:38.140056 10112 timestamp_advancement-itest.cc:267] GCing logs...
I20260204 09:11:38.140122 10112 log_reader.cc:385] T 32ad7b3e12874e8eb2604956e74c7ca5: removed 1 log segments from log reader
I20260204 09:11:38.140149 10112 log.cc:1079] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae: Deleting log segment in path: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1770196261863819-10112-0/minicluster-data/ts-0-root/wals/32ad7b3e12874e8eb2604956e74c7ca5/wal-000000001 (ops 1-18)
I20260204 09:11:38.140688 10112 timestamp_advancement-itest.cc:274] Shutting down cluster...
I20260204 09:11:38.140734 10112 master.cc:561] Master@127.9.224.62:41859 shutting down...
I20260204 09:11:38.143316 11096 catalog_manager.cc:5201] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 32ad7b3e12874e8eb2604956e74c7ca5 with cas_config_opid_index 25: aborting the task: latest config opid_index 38; task opid_index 25
I20260204 09:11:38.146513 11093 catalog_manager.cc:5201] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 32ad7b3e12874e8eb2604956e74c7ca5 with cas_config_opid_index 19: aborting the task: latest config opid_index 38; task opid_index 19
I20260204 09:11:38.153465 11096 catalog_manager.cc:5201] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 32ad7b3e12874e8eb2604956e74c7ca5 with cas_config_opid_index 27: aborting the task: latest config opid_index 38; task opid_index 27
I20260204 09:11:38.165120 11094 catalog_manager.cc:5201] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 32ad7b3e12874e8eb2604956e74c7ca5 with cas_config_opid_index 37: aborting the task: latest config opid_index 38; task opid_index 37
I20260204 09:11:38.168617 11096 catalog_manager.cc:5201] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 32ad7b3e12874e8eb2604956e74c7ca5 with cas_config_opid_index 23: aborting the task: latest config opid_index 38; task opid_index 23
I20260204 09:11:38.169298 11094 catalog_manager.cc:5201] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 32ad7b3e12874e8eb2604956e74c7ca5 with cas_config_opid_index 35: aborting the task: latest config opid_index 38; task opid_index 35
I20260204 09:11:38.173748 11096 catalog_manager.cc:5201] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 32ad7b3e12874e8eb2604956e74c7ca5 with cas_config_opid_index 31: aborting the task: latest config opid_index 38; task opid_index 31
I20260204 09:11:38.183022 11095 catalog_manager.cc:5201] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 32ad7b3e12874e8eb2604956e74c7ca5 with cas_config_opid_index 29: aborting the task: latest config opid_index 38; task opid_index 29
I20260204 09:11:38.188997 11096 catalog_manager.cc:5201] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 32ad7b3e12874e8eb2604956e74c7ca5 with cas_config_opid_index 33: aborting the task: latest config opid_index 38; task opid_index 33
I20260204 09:11:38.189244 10112 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b376c39d64b6423181536142ceb472e3 [term 1 LEADER]: Raft consensus shutting down.
I20260204 09:11:38.189330 10112 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b376c39d64b6423181536142ceb472e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 09:11:38.189491 10112 tablet_replica.cc:333] T 00000000000000000000000000000000 P b376c39d64b6423181536142ceb472e3: stopping tablet replica
I20260204 09:11:38.201705 10112 master.cc:583] Master@127.9.224.62:41859 shutdown complete.
I20260204 09:11:38.203141 10112 tablet_server.cc:178] TabletServer@127.9.224.1:0 shutting down...
I20260204 09:11:38.437968 10112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260204 09:11:38.438176 10112 tablet_replica.cc:333] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae: stopping tablet replica
I20260204 09:11:38.438233 10112 raft_consensus.cc:2243] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 09:11:38.438383 10112 raft_consensus.cc:2272] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 09:11:38.450294 10112 tablet_server.cc:195] TabletServer@127.9.224.1:0 shutdown complete.
I20260204 09:11:38.451395 10112 tablet_server.cc:178] TabletServer@127.9.224.2:0 shutting down...
I20260204 09:11:38.462538 10112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260204 09:11:38.462713 10112 tablet_replica.cc:333] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26: stopping tablet replica
I20260204 09:11:38.462769 10112 raft_consensus.cc:2243] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [term 1 LEADER]: Raft consensus shutting down.
I20260204 09:11:38.462847 10112 raft_consensus.cc:2272] T 32ad7b3e12874e8eb2604956e74c7ca5 P 089ac33f27a3476d87b25272430cba26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 09:11:38.475220 10112 tablet_server.cc:195] TabletServer@127.9.224.2:0 shutdown complete.
I20260204 09:11:38.476122 10112 tablet_server.cc:178] TabletServer@127.9.224.3:0 shutting down...
I20260204 09:11:38.498932 10112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260204 09:11:38.499107 10112 tablet_replica.cc:333] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e: stopping tablet replica
I20260204 09:11:38.499155 10112 raft_consensus.cc:2243] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 09:11:38.499220 10112 raft_consensus.cc:2272] T 32ad7b3e12874e8eb2604956e74c7ca5 P 0350731cd29d4bdaa802b6131c95d68e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 09:11:38.511056 10112 tablet_server.cc:195] TabletServer@127.9.224.3:0 shutdown complete.
I20260204 09:11:38.511960 10112 timestamp_advancement-itest.cc:282] Restarting single tablet server...
I20260204 09:11:38.512077 10112 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 09:11:38.513403 11447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 09:11:38.513444 10112 server_base.cc:1060] running on GCE node
W20260204 09:11:38.513347 11450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 09:11:38.513451 11448 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 09:11:38.513716 10112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 09:11:38.513752 10112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 09:11:38.513767 10112 hybrid_clock.cc:648] HybridClock initialized: now 1770196298513767 us; error 0 us; skew 500 ppm
I20260204 09:11:38.514276 10112 webserver.cc:492] Webserver started at http://127.9.224.1:45983/ using document root <none> and password file <none>
I20260204 09:11:38.514345 10112 fs_manager.cc:362] Metadata directory not provided
I20260204 09:11:38.514370 10112 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260204 09:11:38.514954 10112 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:38.516140 11457 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:38.516254 10112 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260204 09:11:38.516305 10112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1770196261863819-10112-0/minicluster-data/ts-0-root
uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae"
format_stamp: "Formatted at 2026-02-04 09:11:37 on dist-test-slave-4hq3"
I20260204 09:11:38.516353 10112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1770196261863819-10112-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1770196261863819-10112-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1770196261863819-10112-0/minicluster-data/ts-0-root/data
Total live blocks: 5
Total live bytes: 5429
Total live bytes (after alignment): 24576
Total number of LBM containers: 6 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 09:11:38.523216 10112 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 09:11:38.523378 10112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 09:11:38.523517 10112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260204 09:11:38.524248 10112 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260204 09:11:38.524279 10112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20260204 09:11:38.524684 10112 ts_tablet_manager.cc:616] Registered 1 tablets
I20260204 09:11:38.524712 10112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:38.524730 11464 tablet_bootstrap.cc:492] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae: Bootstrap starting.
I20260204 09:11:38.526428 11464 tablet_bootstrap.cc:492] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae: Bootstrap replayed 1/1 log segments. Stats: ops{read=20 overwritten=0 applied=20 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 09:11:38.526626 11464 tablet_bootstrap.cc:492] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae: Bootstrap complete.
I20260204 09:11:38.526722 11464 ts_tablet_manager.cc:1403] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260204 09:11:38.526834 11464 raft_consensus.cc:359] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 38 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } }
I20260204 09:11:38.526904 11464 raft_consensus.cc:740] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6a93f0e7e1e445ba8ac26f1ba48f1ae, State: Initialized, Role: FOLLOWER
I20260204 09:11:38.526961 11464 consensus_queue.cc:260] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 38, Last appended: 1.38, Last appended by leader: 38, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 38 OBSOLETE_local: false peers { permanent_uuid: "089ac33f27a3476d87b25272430cba26" member_type: VOTER last_known_addr { host: "127.9.224.2" port: 35759 } } peers { permanent_uuid: "0350731cd29d4bdaa802b6131c95d68e" member_type: VOTER last_known_addr { host: "127.9.224.3" port: 43961 } } peers { permanent_uuid: "d6a93f0e7e1e445ba8ac26f1ba48f1ae" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34311 } }
I20260204 09:11:38.527103 11464 ts_tablet_manager.cc:1434] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae: Time spent starting tablet: real 0.000s user 0.000s sys 0.002s
I20260204 09:11:38.527726 10112 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.1:34311
I20260204 09:11:38.529983 11523 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.224.1:34311 every 8 connection(s)
W20260204 09:11:38.530860 11524 heartbeater.cc:412] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260204 09:11:38.534745 11477 tablet_service.cc:3012] Rejecting scan request for tablet 32ad7b3e12874e8eb2604956e74c7ca5: Uninitialized: clean time has not yet been initialized
I20260204 09:11:38.534950 10112 timestamp_advancement-itest.cc:447] Got response: error { code: TABLET_NOT_RUNNING status { code: UNINITIALIZED message: "clean time has not yet been initialized" } }
I20260204 09:11:38.535241 10112 tablet_server.cc:178] TabletServer@127.9.224.1:34311 shutting down...
I20260204 09:11:38.780417 10112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260204 09:11:38.780642 10112 tablet_replica.cc:333] stopping tablet replica
I20260204 09:11:38.780725 10112 raft_consensus.cc:2243] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260204 09:11:38.780783 10112 raft_consensus.cc:2272] T 32ad7b3e12874e8eb2604956e74c7ca5 P d6a93f0e7e1e445ba8ac26f1ba48f1ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 09:11:38.792251 10112 tablet_server.cc:195] TabletServer@127.9.224.1:34311 shutdown complete.
[ OK ] TimestampAdvancementITest.Kudu2463Test (920 ms)
[ RUN ] TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp
I20260204 09:11:38.796089 10112 timestamp_advancement-itest.cc:460] Running with 1 replicas
I20260204 09:11:38.796227 10112 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.224.62:41249
I20260204 09:11:38.796357 10112 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 09:11:38.797412 11531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 09:11:38.797508 11528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 09:11:38.797510 10112 server_base.cc:1060] running on GCE node
W20260204 09:11:38.797575 11529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 09:11:38.797722 10112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 09:11:38.797753 10112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 09:11:38.797765 10112 hybrid_clock.cc:648] HybridClock initialized: now 1770196298797765 us; error 0 us; skew 500 ppm
I20260204 09:11:38.798206 10112 webserver.cc:492] Webserver started at http://127.9.224.62:36957/ using document root <none> and password file <none>
I20260204 09:11:38.798276 10112 fs_manager.cc:362] Metadata directory not provided
I20260204 09:11:38.798308 10112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 09:11:38.798342 10112 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 09:11:38.798606 10112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1770196261863819-10112-0/minicluster-data/master-0-root/instance:
uuid: "9f16879244cf42418ead50fef5ca9b24"
format_stamp: "Formatted at 2026-02-04 09:11:38 on dist-test-slave-4hq3"
I20260204 09:11:38.799346 10112 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260204 09:11:38.799722 11536 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:38.799834 10112 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:38.799875 10112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1770196261863819-10112-0/minicluster-data/master-0-root
uuid: "9f16879244cf42418ead50fef5ca9b24"
format_stamp: "Formatted at 2026-02-04 09:11:38 on dist-test-slave-4hq3"
I20260204 09:11:38.799914 10112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1770196261863819-10112-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1770196261863819-10112-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1770196261863819-10112-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 09:11:38.804500 10112 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 09:11:38.804647 10112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 09:11:38.807431 10112 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.62:41249
I20260204 09:11:38.807946 11588 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.224.62:41249 every 8 connection(s)
I20260204 09:11:38.808045 11589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 09:11:38.808944 11589 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24: Bootstrap starting.
I20260204 09:11:38.809173 11589 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24: Neither blocks nor log segments found. Creating new log.
I20260204 09:11:38.809721 11589 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24: No bootstrap required, opened a new log
I20260204 09:11:38.809825 11589 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f16879244cf42418ead50fef5ca9b24" member_type: VOTER }
I20260204 09:11:38.809868 11589 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 09:11:38.809880 11589 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f16879244cf42418ead50fef5ca9b24, State: Initialized, Role: FOLLOWER
I20260204 09:11:38.809916 11589 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f16879244cf42418ead50fef5ca9b24" member_type: VOTER }
I20260204 09:11:38.809950 11589 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260204 09:11:38.809969 11589 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260204 09:11:38.809988 11589 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [term 0 FOLLOWER]: Advancing to term 1
I20260204 09:11:38.810429 11589 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f16879244cf42418ead50fef5ca9b24" member_type: VOTER }
I20260204 09:11:38.810482 11589 leader_election.cc:304] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9f16879244cf42418ead50fef5ca9b24; no voters:
I20260204 09:11:38.810577 11589 leader_election.cc:290] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260204 09:11:38.810626 11592 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [term 1 FOLLOWER]: Leader election won for term 1
I20260204 09:11:38.810708 11589 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [sys.catalog]: configured and running, proceeding with master startup.
I20260204 09:11:38.810765 11592 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [term 1 LEADER]: Becoming Leader. State: Replica: 9f16879244cf42418ead50fef5ca9b24, State: Running, Role: LEADER
I20260204 09:11:38.810828 11592 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f16879244cf42418ead50fef5ca9b24" member_type: VOTER }
I20260204 09:11:38.811057 11593 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9f16879244cf42418ead50fef5ca9b24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f16879244cf42418ead50fef5ca9b24" member_type: VOTER } }
I20260204 09:11:38.811065 11594 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9f16879244cf42418ead50fef5ca9b24. Latest consensus state: current_term: 1 leader_uuid: "9f16879244cf42418ead50fef5ca9b24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f16879244cf42418ead50fef5ca9b24" member_type: VOTER } }
I20260204 09:11:38.811196 11593 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [sys.catalog]: This master's current role is: LEADER
I20260204 09:11:38.811213 11594 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [sys.catalog]: This master's current role is: LEADER
I20260204 09:11:38.811419 11599 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260204 09:11:38.811551 11599 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260204 09:11:38.811903 10112 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260204 09:11:38.812084 11599 catalog_manager.cc:1357] Generated new cluster ID: 5ba0e747ed6f4b7783c412506da3e424
I20260204 09:11:38.812122 11599 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260204 09:11:38.823081 11599 catalog_manager.cc:1380] Generated new certificate authority record
I20260204 09:11:38.823470 11599 catalog_manager.cc:1514] Loading token signing keys...
I20260204 09:11:38.835186 11599 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24: Generated new TSK 0
I20260204 09:11:38.835258 11599 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260204 09:11:38.843607 10112 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 09:11:38.844878 11611 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 09:11:38.844964 10112 server_base.cc:1060] running on GCE node
W20260204 09:11:38.845021 11613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 09:11:38.845088 11610 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 09:11:38.845239 10112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 09:11:38.845278 10112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 09:11:38.845290 10112 hybrid_clock.cc:648] HybridClock initialized: now 1770196298845291 us; error 0 us; skew 500 ppm
I20260204 09:11:38.845862 10112 webserver.cc:492] Webserver started at http://127.9.224.1:45727/ using document root <none> and password file <none>
I20260204 09:11:38.845930 10112 fs_manager.cc:362] Metadata directory not provided
I20260204 09:11:38.845976 10112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 09:11:38.846022 10112 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 09:11:38.846261 10112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1770196261863819-10112-0/minicluster-data/ts-0-root/instance:
uuid: "6777b20277e844079027bd5f6d13d90c"
format_stamp: "Formatted at 2026-02-04 09:11:38 on dist-test-slave-4hq3"
I20260204 09:11:38.847055 10112 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260204 09:11:38.847427 11618 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:38.847527 10112 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:38.847565 10112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1770196261863819-10112-0/minicluster-data/ts-0-root
uuid: "6777b20277e844079027bd5f6d13d90c"
format_stamp: "Formatted at 2026-02-04 09:11:38 on dist-test-slave-4hq3"
I20260204 09:11:38.847610 10112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1770196261863819-10112-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1770196261863819-10112-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1770196261863819-10112-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 09:11:38.857049 10112 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 09:11:38.857223 10112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 09:11:38.857342 10112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260204 09:11:38.857547 10112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260204 09:11:38.857573 10112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:38.857599 10112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260204 09:11:38.857621 10112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:38.860176 10112 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.1:34495
I20260204 09:11:38.860234 11681 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.224.1:34495 every 8 connection(s)
I20260204 09:11:38.863161 11682 heartbeater.cc:344] Connected to a master server at 127.9.224.62:41249
I20260204 09:11:38.863214 11682 heartbeater.cc:461] Registering TS with master...
I20260204 09:11:38.863312 11682 heartbeater.cc:507] Master 127.9.224.62:41249 requested a full tablet report, sending...
I20260204 09:11:38.863538 11553 ts_manager.cc:194] Registered new tserver with Master: 6777b20277e844079027bd5f6d13d90c (127.9.224.1:34495)
I20260204 09:11:38.863583 10112 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.00323337s
I20260204 09:11:38.864300 11553 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41010
I20260204 09:11:38.873562 11553 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41036:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260204 09:11:38.877182 11646 tablet_service.cc:1505] Processing CreateTablet for tablet 432dd428cdd946579a894eceb89698b5 (DEFAULT_TABLE table=test-workload [id=702b195c91304d0390f71882d6ea2138]), partition=RANGE (key) PARTITION UNBOUNDED
I20260204 09:11:38.877295 11646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 432dd428cdd946579a894eceb89698b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260204 09:11:38.878429 11700 tablet_bootstrap.cc:492] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c: Bootstrap starting.
I20260204 09:11:38.878721 11700 tablet_bootstrap.cc:654] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c: Neither blocks nor log segments found. Creating new log.
I20260204 09:11:38.879180 11700 tablet_bootstrap.cc:492] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c: No bootstrap required, opened a new log
I20260204 09:11:38.879220 11700 ts_tablet_manager.cc:1403] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260204 09:11:38.879343 11700 raft_consensus.cc:359] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6777b20277e844079027bd5f6d13d90c" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34495 } }
I20260204 09:11:38.879388 11700 raft_consensus.cc:385] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260204 09:11:38.879406 11700 raft_consensus.cc:740] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6777b20277e844079027bd5f6d13d90c, State: Initialized, Role: FOLLOWER
I20260204 09:11:38.879449 11700 consensus_queue.cc:260] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6777b20277e844079027bd5f6d13d90c" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34495 } }
I20260204 09:11:38.879487 11700 raft_consensus.cc:399] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260204 09:11:38.879506 11700 raft_consensus.cc:493] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260204 09:11:38.879531 11700 raft_consensus.cc:3060] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c [term 0 FOLLOWER]: Advancing to term 1
I20260204 09:11:38.880016 11700 raft_consensus.cc:515] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6777b20277e844079027bd5f6d13d90c" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34495 } }
I20260204 09:11:38.880074 11700 leader_election.cc:304] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6777b20277e844079027bd5f6d13d90c; no voters:
I20260204 09:11:38.880177 11700 leader_election.cc:290] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260204 09:11:38.880218 11702 raft_consensus.cc:2804] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c [term 1 FOLLOWER]: Leader election won for term 1
I20260204 09:11:38.880306 11700 ts_tablet_manager.cc:1434] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260204 09:11:38.880345 11702 raft_consensus.cc:697] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c [term 1 LEADER]: Becoming Leader. State: Replica: 6777b20277e844079027bd5f6d13d90c, State: Running, Role: LEADER
I20260204 09:11:38.880378 11682 heartbeater.cc:499] Master 127.9.224.62:41249 was elected leader, sending a full tablet report...
I20260204 09:11:38.880395 11702 consensus_queue.cc:237] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6777b20277e844079027bd5f6d13d90c" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34495 } }
I20260204 09:11:38.880807 11553 catalog_manager.cc:5654] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6777b20277e844079027bd5f6d13d90c (127.9.224.1). New cstate: current_term: 1 leader_uuid: "6777b20277e844079027bd5f6d13d90c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6777b20277e844079027bd5f6d13d90c" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34495 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:38.883343 10112 tablet_server.cc:178] TabletServer@127.9.224.1:0 shutting down...
I20260204 09:11:38.885429 10112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260204 09:11:38.885560 10112 tablet_replica.cc:333] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c: stopping tablet replica
I20260204 09:11:38.885609 10112 raft_consensus.cc:2243] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c [term 1 LEADER]: Raft consensus shutting down.
I20260204 09:11:38.885656 10112 raft_consensus.cc:2272] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 09:11:38.897179 10112 tablet_server.cc:195] TabletServer@127.9.224.1:0 shutdown complete.
I20260204 09:11:38.898136 10112 master.cc:561] Master@127.9.224.62:41249 shutting down...
I20260204 09:11:38.900144 10112 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [term 1 LEADER]: Raft consensus shutting down.
I20260204 09:11:38.900202 10112 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260204 09:11:38.900260 10112 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24: stopping tablet replica
I20260204 09:11:38.911984 10112 master.cc:583] Master@127.9.224.62:41249 shutdown complete.
I20260204 09:11:38.913416 10112 timestamp_advancement-itest.cc:460] Running with 3 replicas
I20260204 09:11:38.913578 10112 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.224.62:46363
I20260204 09:11:38.913688 10112 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 09:11:38.914774 11708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 09:11:38.914772 11707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 09:11:38.914973 10112 server_base.cc:1060] running on GCE node
W20260204 09:11:38.915048 11710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 09:11:38.915140 10112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 09:11:38.915167 10112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 09:11:38.915179 10112 hybrid_clock.cc:648] HybridClock initialized: now 1770196298915179 us; error 0 us; skew 500 ppm
I20260204 09:11:38.915725 10112 webserver.cc:492] Webserver started at http://127.9.224.62:36041/ using document root <none> and password file <none>
I20260204 09:11:38.915798 10112 fs_manager.cc:362] Metadata directory not provided
I20260204 09:11:38.915817 10112 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260204 09:11:38.916275 10112 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:38.916647 11715 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:38.916754 10112 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:38.916786 10112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1770196261863819-10112-0/minicluster-data/master-0-root
uuid: "9f16879244cf42418ead50fef5ca9b24"
format_stamp: "Formatted at 2026-02-04 09:11:38 on dist-test-slave-4hq3"
I20260204 09:11:38.916828 10112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1770196261863819-10112-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1770196261863819-10112-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1770196261863819-10112-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 09:11:38.921058 10112 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 09:11:38.921200 10112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 09:11:38.923460 10112 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.62:46363
I20260204 09:11:38.924165 11767 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.224.62:46363 every 8 connection(s)
I20260204 09:11:38.924639 11768 sys_catalog.cc:263] Verifying existing consensus state
I20260204 09:11:38.924937 11768 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24: Bootstrap starting.
I20260204 09:11:38.926218 11768 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=5 ignored=0} mutations{seen=2 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 09:11:38.926393 11768 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24: Bootstrap complete.
I20260204 09:11:38.926551 11768 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f16879244cf42418ead50fef5ca9b24" member_type: VOTER }
I20260204 09:11:38.926600 11768 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f16879244cf42418ead50fef5ca9b24, State: Initialized, Role: FOLLOWER
I20260204 09:11:38.926633 11768 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f16879244cf42418ead50fef5ca9b24" member_type: VOTER }
I20260204 09:11:38.926668 11768 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260204 09:11:38.926687 11768 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260204 09:11:38.926705 11768 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [term 1 FOLLOWER]: Advancing to term 2
I20260204 09:11:38.927156 11768 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f16879244cf42418ead50fef5ca9b24" member_type: VOTER }
I20260204 09:11:38.927205 11768 leader_election.cc:304] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9f16879244cf42418ead50fef5ca9b24; no voters:
I20260204 09:11:38.927281 11768 leader_election.cc:290] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260204 09:11:38.927330 11771 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [term 2 FOLLOWER]: Leader election won for term 2
I20260204 09:11:38.927399 11768 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [sys.catalog]: configured and running, proceeding with master startup.
I20260204 09:11:38.927452 11771 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [term 2 LEADER]: Becoming Leader. State: Replica: 9f16879244cf42418ead50fef5ca9b24, State: Running, Role: LEADER
I20260204 09:11:38.927503 11771 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f16879244cf42418ead50fef5ca9b24" member_type: VOTER }
I20260204 09:11:38.927704 11772 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "9f16879244cf42418ead50fef5ca9b24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f16879244cf42418ead50fef5ca9b24" member_type: VOTER } }
I20260204 09:11:38.927785 11772 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [sys.catalog]: This master's current role is: LEADER
I20260204 09:11:38.927724 11773 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9f16879244cf42418ead50fef5ca9b24. Latest consensus state: current_term: 2 leader_uuid: "9f16879244cf42418ead50fef5ca9b24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f16879244cf42418ead50fef5ca9b24" member_type: VOTER } }
I20260204 09:11:38.927914 11773 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [sys.catalog]: This master's current role is: LEADER
I20260204 09:11:38.927922 11778 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260204 09:11:38.928187 11778 catalog_manager.cc:679] Loaded metadata for table test-workload [id=702b195c91304d0390f71882d6ea2138]
I20260204 09:11:38.928311 11778 tablet_loader.cc:96] loaded metadata for tablet 432dd428cdd946579a894eceb89698b5 (table test-workload [id=702b195c91304d0390f71882d6ea2138])
I20260204 09:11:38.928357 11778 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260204 09:11:38.928438 11778 catalog_manager.cc:1269] Loaded cluster ID: 5ba0e747ed6f4b7783c412506da3e424
I20260204 09:11:38.928470 11778 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260204 09:11:38.928629 10112 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260204 09:11:38.929221 11778 catalog_manager.cc:1514] Loading token signing keys...
I20260204 09:11:38.929325 11778 catalog_manager.cc:6038] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24: Loaded TSK: 0
I20260204 09:11:38.929445 11778 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260204 09:11:38.929847 10112 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 09:11:38.930784 11788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 09:11:38.930827 11789 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 09:11:38.930938 11791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 09:11:38.931038 10112 server_base.cc:1060] running on GCE node
I20260204 09:11:38.931113 10112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 09:11:38.931139 10112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 09:11:38.931149 10112 hybrid_clock.cc:648] HybridClock initialized: now 1770196298931150 us; error 0 us; skew 500 ppm
I20260204 09:11:38.931592 10112 webserver.cc:492] Webserver started at http://127.9.224.1:34075/ using document root <none> and password file <none>
I20260204 09:11:38.931653 10112 fs_manager.cc:362] Metadata directory not provided
I20260204 09:11:38.931675 10112 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260204 09:11:38.932093 10112 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:38.932423 11796 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:38.932509 10112 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:38.932548 10112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1770196261863819-10112-0/minicluster-data/ts-0-root
uuid: "6777b20277e844079027bd5f6d13d90c"
format_stamp: "Formatted at 2026-02-04 09:11:38 on dist-test-slave-4hq3"
I20260204 09:11:38.932585 10112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1770196261863819-10112-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1770196261863819-10112-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1770196261863819-10112-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 09:11:38.946758 10112 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 09:11:38.946931 10112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 09:11:38.947044 10112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260204 09:11:38.947276 11803 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260204 09:11:38.947773 10112 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260204 09:11:38.947806 10112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20260204 09:11:38.947834 10112 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260204 09:11:38.948194 10112 ts_tablet_manager.cc:616] Registered 1 tablets
I20260204 09:11:38.948220 10112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:38.948223 11803 tablet_bootstrap.cc:492] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c: Bootstrap starting.
I20260204 09:11:38.949146 11803 tablet_bootstrap.cc:492] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260204 09:11:38.949312 11803 tablet_bootstrap.cc:492] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c: Bootstrap complete.
I20260204 09:11:38.949420 11803 ts_tablet_manager.cc:1403] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260204 09:11:38.949534 11803 raft_consensus.cc:359] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6777b20277e844079027bd5f6d13d90c" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34495 } }
I20260204 09:11:38.949581 11803 raft_consensus.cc:740] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6777b20277e844079027bd5f6d13d90c, State: Initialized, Role: FOLLOWER
I20260204 09:11:38.949615 11803 consensus_queue.cc:260] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6777b20277e844079027bd5f6d13d90c" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34495 } }
I20260204 09:11:38.949656 11803 raft_consensus.cc:399] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260204 09:11:38.949678 11803 raft_consensus.cc:493] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260204 09:11:38.949692 11803 raft_consensus.cc:3060] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c [term 1 FOLLOWER]: Advancing to term 2
I20260204 09:11:38.950214 11803 raft_consensus.cc:515] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6777b20277e844079027bd5f6d13d90c" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34495 } }
I20260204 09:11:38.950268 11803 leader_election.cc:304] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6777b20277e844079027bd5f6d13d90c; no voters:
I20260204 09:11:38.950353 11803 leader_election.cc:290] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260204 09:11:38.950472 11803 ts_tablet_manager.cc:1434] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260204 09:11:38.950465 11846 raft_consensus.cc:2804] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c [term 2 FOLLOWER]: Leader election won for term 2
I20260204 09:11:38.950577 11846 raft_consensus.cc:697] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c [term 2 LEADER]: Becoming Leader. State: Replica: 6777b20277e844079027bd5f6d13d90c, State: Running, Role: LEADER
I20260204 09:11:38.950619 11846 consensus_queue.cc:237] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6777b20277e844079027bd5f6d13d90c" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34495 } }
I20260204 09:11:38.951418 10112 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.1:37563
I20260204 09:11:38.951478 11865 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.224.1:37563 every 8 connection(s)
I20260204 09:11:38.951741 10112 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 09:11:38.952646 11870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 09:11:38.952801 11871 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 09:11:38.952663 11873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 09:11:38.952862 10112 server_base.cc:1060] running on GCE node
I20260204 09:11:38.953065 10112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 09:11:38.953099 10112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 09:11:38.953115 10112 hybrid_clock.cc:648] HybridClock initialized: now 1770196298953116 us; error 0 us; skew 500 ppm
I20260204 09:11:38.953727 10112 webserver.cc:492] Webserver started at http://127.9.224.2:32793/ using document root <none> and password file <none>
I20260204 09:11:38.953819 10112 fs_manager.cc:362] Metadata directory not provided
I20260204 09:11:38.953860 10112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 09:11:38.953903 10112 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 09:11:38.954159 10112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1770196261863819-10112-0/minicluster-data/ts-1-root/instance:
uuid: "db9346adf3a64b90906831a75845b5e7"
format_stamp: "Formatted at 2026-02-04 09:11:38 on dist-test-slave-4hq3"
I20260204 09:11:38.954881 11866 heartbeater.cc:344] Connected to a master server at 127.9.224.62:46363
I20260204 09:11:38.954944 11866 heartbeater.cc:461] Registering TS with master...
I20260204 09:11:38.955045 11866 heartbeater.cc:507] Master 127.9.224.62:46363 requested a full tablet report, sending...
I20260204 09:11:38.955080 10112 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260204 09:11:38.955312 11732 ts_manager.cc:194] Registered new tserver with Master: 6777b20277e844079027bd5f6d13d90c (127.9.224.1:37563)
I20260204 09:11:38.955371 11732 catalog_manager.cc:5654] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "6777b20277e844079027bd5f6d13d90c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6777b20277e844079027bd5f6d13d90c" member_type: VOTER last_known_addr { host: "127.9.224.1" port: 34495 } health_report { overall_health: HEALTHY } } }
I20260204 09:11:38.955509 11878 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:38.955637 10112 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:38.955687 10112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1770196261863819-10112-0/minicluster-data/ts-1-root
uuid: "db9346adf3a64b90906831a75845b5e7"
format_stamp: "Formatted at 2026-02-04 09:11:38 on dist-test-slave-4hq3"
I20260204 09:11:38.955726 10112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1770196261863819-10112-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1770196261863819-10112-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1770196261863819-10112-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 09:11:38.956498 11732 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36988
I20260204 09:11:38.956890 11866 heartbeater.cc:499] Master 127.9.224.62:46363 was elected leader, sending a full tablet report...
I20260204 09:11:38.980969 10112 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 09:11:38.981190 10112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 09:11:38.981331 10112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260204 09:11:38.981550 10112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260204 09:11:38.981576 10112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:38.981596 10112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260204 09:11:38.981612 10112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:38.984627 10112 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.2:33361
I20260204 09:11:38.984683 11942 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.224.2:33361 every 8 connection(s)
I20260204 09:11:38.984987 10112 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260204 09:11:38.986114 11947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 09:11:38.986181 11946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260204 09:11:38.986414 11949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260204 09:11:38.986568 10112 server_base.cc:1060] running on GCE node
I20260204 09:11:38.986675 10112 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260204 09:11:38.986703 10112 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260204 09:11:38.986728 10112 hybrid_clock.cc:648] HybridClock initialized: now 1770196298986728 us; error 0 us; skew 500 ppm
I20260204 09:11:38.987285 10112 webserver.cc:492] Webserver started at http://127.9.224.3:38725/ using document root <none> and password file <none>
I20260204 09:11:38.987367 10112 fs_manager.cc:362] Metadata directory not provided
I20260204 09:11:38.987411 10112 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260204 09:11:38.987462 10112 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260204 09:11:38.987773 10112 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1770196261863819-10112-0/minicluster-data/ts-2-root/instance:
uuid: "2405c7ed0c094a76b3ea24f025341918"
format_stamp: "Formatted at 2026-02-04 09:11:38 on dist-test-slave-4hq3"
I20260204 09:11:38.988063 11943 heartbeater.cc:344] Connected to a master server at 127.9.224.62:46363
I20260204 09:11:38.988119 11943 heartbeater.cc:461] Registering TS with master...
I20260204 09:11:38.988217 11943 heartbeater.cc:507] Master 127.9.224.62:46363 requested a full tablet report, sending...
I20260204 09:11:38.988412 11732 ts_manager.cc:194] Registered new tserver with Master: db9346adf3a64b90906831a75845b5e7 (127.9.224.2:33361)
I20260204 09:11:38.988760 10112 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260204 09:11:38.988829 11732 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36994
I20260204 09:11:38.989171 11954 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:38.989282 10112 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:38.989324 10112 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1770196261863819-10112-0/minicluster-data/ts-2-root
uuid: "2405c7ed0c094a76b3ea24f025341918"
format_stamp: "Formatted at 2026-02-04 09:11:38 on dist-test-slave-4hq3"
I20260204 09:11:38.989377 10112 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1770196261863819-10112-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1770196261863819-10112-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task3Qixf7/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1770196261863819-10112-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260204 09:11:38.993402 10112 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260204 09:11:38.993563 10112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260204 09:11:38.993667 10112 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260204 09:11:38.993800 10112 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260204 09:11:38.993822 10112 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:38.993844 10112 ts_tablet_manager.cc:616] Registered 0 tablets
I20260204 09:11:38.993860 10112 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260204 09:11:38.996802 10112 rpc_server.cc:307] RPC server started. Bound to: 127.9.224.3:39047
I20260204 09:11:38.996862 12017 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.224.3:39047 every 8 connection(s)
I20260204 09:11:38.999328 12018 heartbeater.cc:344] Connected to a master server at 127.9.224.62:46363
I20260204 09:11:38.999375 12018 heartbeater.cc:461] Registering TS with master...
I20260204 09:11:38.999475 12018 heartbeater.cc:507] Master 127.9.224.62:46363 requested a full tablet report, sending...
I20260204 09:11:38.999675 11732 ts_manager.cc:194] Registered new tserver with Master: 2405c7ed0c094a76b3ea24f025341918 (127.9.224.3:39047)
I20260204 09:11:38.999980 11732 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36996
I20260204 09:11:39.000285 10112 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.00332449s
I20260204 09:11:39.010475 10112 test_workload.cc:405] TestWorkload: Skipping table creation because table test-workload already exists
I20260204 09:11:39.010546 10112 tablet_server.cc:178] TabletServer@127.9.224.1:0 shutting down...
I20260204 09:11:39.012545 10112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260204 09:11:39.012758 10112 tablet_replica.cc:333] stopping tablet replica
I20260204 09:11:39.012818 10112 raft_consensus.cc:2243] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c [term 2 LEADER]: Raft consensus shutting down.
I20260204 09:11:39.012861 10112 raft_consensus.cc:2272] T 432dd428cdd946579a894eceb89698b5 P 6777b20277e844079027bd5f6d13d90c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 09:11:39.024408 10112 tablet_server.cc:195] TabletServer@127.9.224.1:0 shutdown complete.
I20260204 09:11:39.025197 10112 tablet_server.cc:178] TabletServer@127.9.224.2:0 shutting down...
I20260204 09:11:39.027446 10112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260204 09:11:39.038612 10112 tablet_server.cc:195] TabletServer@127.9.224.2:0 shutdown complete.
I20260204 09:11:39.039389 10112 tablet_server.cc:178] TabletServer@127.9.224.3:0 shutting down...
I20260204 09:11:39.041695 10112 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260204 09:11:39.052973 10112 tablet_server.cc:195] TabletServer@127.9.224.3:0 shutdown complete.
I20260204 09:11:39.053812 10112 master.cc:561] Master@127.9.224.62:46363 shutting down...
I20260204 09:11:39.055775 10112 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [term 2 LEADER]: Raft consensus shutting down.
I20260204 09:11:39.055840 10112 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9f16879244cf42418ead50fef5ca9b24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260204 09:11:39.055917 10112 tablet_replica.cc:333] stopping tablet replica
I20260204 09:11:39.057557 10112 master.cc:583] Master@127.9.224.62:46363 shutdown complete.
[ OK ] TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp (265 ms)
[----------] 4 tests from TimestampAdvancementITest (37192 ms total)
[----------] Global test environment tear-down
[==========] 4 tests from 1 test suite ran. (37192 ms total)
[ PASSED ] 3 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData
1 FAILED TEST
I20260204 09:11:39.061219 10112 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/master/catalog_manager.cc:5332: suppressed but not reported on 9 messages since previous log ~0 seconds ago
I20260204 09:11:39.061244 10112 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 13 messages since previous log ~2 seconds ago
I20260204 09:11:39.061267 10112 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 15 messages since previous log ~4 seconds ago
I20260204 09:11:39.061321 10112 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/util/maintenance_manager.cc:346: suppressed but not reported on 570 messages since previous log ~37 seconds ago